-- Logs begin at Wed 2021-09-22 12:15:20 UTC, end at Wed 2021-09-22 13:29:54 UTC. -- Sep 22 13:02:08.253490 dv-cinder-810000-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 13:02:08.262541 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 22 13:02:08 2021] *** Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: nodename: dv-cinder-810000-3-iscsi Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: machine: x86_64 Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: clock source: unix Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: pcre jit disabled Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: detected number of CPU cores: 4 Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: current working directory: / Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: detected binary path: /usr/bin/uwsgi-core Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: your processes number limit is 47680 Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: your memory page size is 4096 bytes Sep 22 13:02:08.264227 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: detected max file descriptor number: 2048 Sep 22 13:02:08.265240 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: lock engine: pthread robust mutexes Sep 22 13:02:08.265240 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: thunder lock: enabled Sep 22 13:02:08.265240 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 13:02:08.265240 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 22 13:02:08.309681 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: Python main interpreter initialized at 0x55728f09b9c0 Sep 22 13:02:08.309681 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: python threads support enabled Sep 22 13:02:08.309681 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: your server socket listen backlog is limited to 100 connections Sep 22 13:02:08.309681 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: your mercy for graceful operations on workers is 90 seconds Sep 22 13:02:08.310101 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 13:02:08.310101 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: *** Operational MODE: preforking *** Sep 22 13:02:08.310396 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: *** uWSGI is running in multiple interpreter mode *** Sep 22 13:02:08.310396 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: spawned uWSGI master process (pid: 94142) Sep 22 13:02:08.310616 dv-cinder-810000-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 13:02:08.312720 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: spawned uWSGI worker 1 (pid: 94143, cores: 1) Sep 22 13:02:08.312720 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: spawned uWSGI worker 2 (pid: 94144, cores: 1) Sep 22 13:02:08.312720 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 13:02:10.008893 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:02:10.008893 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: from cryptography.utils import int_from_bytes Sep 22 13:02:10.009783 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:02:10.009783 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: from cryptography.utils import int_from_bytes Sep 22 13:02:10.010718 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:02:10.010718 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: from cryptography.utils import int_from_bytes Sep 22 13:02:10.011545 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:02:10.011545 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: from cryptography.utils import int_from_bytes Sep 22 13:02:12.762749 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 13:02:12.763293 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 13:02:12.763486 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 13:02:12.763852 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 13:02:12.764109 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 13:02:12.764496 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.764822 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.765144 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.765464 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.765790 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.766106 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.766427 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.766746 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.767072 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.767332 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.767673 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.767994 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810000-3-iscsi {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.768316 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.768624 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.768931 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.769250 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.769552 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.769872 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.770177 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.770669 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.771382 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.771724 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.772132 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.772473 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.772791 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.773103 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.774080 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.774591 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.774921 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 13:02:12.775407 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.775619 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 13:02:12.775768 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.775768 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810000-3-iscsi {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.776053 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 13:02:12.776169 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.776285 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 13:02:12.776285 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 13:02:12.776564 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.776564 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.776796 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.776963 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777065 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777285 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777379 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777594 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777712 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.777917 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778015 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778224 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778315 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778534 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778623 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778852 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.778954 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779168 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779301 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779458 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779613 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779784 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.779891 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780083 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810000-3-iscsi {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780187 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780398 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780487 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780706 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.780817 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781020 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781131 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781323 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781437 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781635 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781753 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781888 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.781997 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.782196 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.782298 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.782519 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.782749 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.782926 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783067 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783161 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783355 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783478 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783651 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783751 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.783974 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784073 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784287 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784373 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784593 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784696 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784898 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.784991 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785200 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785291 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785506 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785599 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785811 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.785895 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786118 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786203 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810000-3-iscsi {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786421 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786509 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786728 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.786811 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787045 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787208 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787359 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787535 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787704 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.787851 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788009 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788164 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788326 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788489 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788722 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.788827 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789120 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789205 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789454 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789538 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789785 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.789965 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790142 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790304 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790472 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790625 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790785 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.790951 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791131 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791284 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791453 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791627 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791791 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.791908 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792018 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792120 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792216 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792314 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792452 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792605 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792760 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.792908 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793085 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793196 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793407 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793539 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793732 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.793838 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794016 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794109 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794214 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794324 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794531 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794618 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794855 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.794949 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795165 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795256 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795497 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795607 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795808 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.795899 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796178 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796272 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796428 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796518 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796735 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.796824 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797032 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797120 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797327 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797417 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797626 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797726 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.797920 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798016 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798230 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798325 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798548 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798654 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798848 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.798935 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.799153 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.799242 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.799474 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.799624 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.799788 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.800116 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.800407 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.800521 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.800712 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.801001 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.801175 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.801616 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.801786 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.801951 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802116 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802295 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802458 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802616 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802770 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.802908 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803067 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803228 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803375 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803589 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803733 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.803886 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.804028 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.804181 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.804348 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805009 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805243 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805466 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805608 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805763 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.805899 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806055 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806200 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806360 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806514 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806651 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806785 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.806917 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807072 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807218 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807367 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807494 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807583 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807662 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807753 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.807834 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808100 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808192 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808529 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808699 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.808800 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809010 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809110 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809328 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809433 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809595 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.809720 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.809920 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.810047 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.810254 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.810385 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.810588 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.810732 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.810906 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.811023 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.811216 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.811310 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.811547 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.811659 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.811854 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.811975 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.812176 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.812450 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.812541 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.812766 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.812856 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.813081 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.813174 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.813391 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.813480 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.813708 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.813797 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.814021 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.814118 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.814344 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.814435 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.814656 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.814752 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.814961 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.815064 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.815273 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.815503 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.815604 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.815931 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.816053 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.816281 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.816540 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.816643 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.816876 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.817030 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.817167 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.817306 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.817465 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.817615 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.817774 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.817924 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.818067 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.818200 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.818342 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.818485 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.818684 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.818830 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.819046 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.819192 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.819358 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.819527 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.819714 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.819866 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.820020 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.820446 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.820446 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.820739 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.820901 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.821058 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:02:12.821193 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.821333 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.821470 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.821612 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.821746 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.821951 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.822585 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.822757 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.822908 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.823071 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.823371 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.823700 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.823998 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824139 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824313 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824447 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824619 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824771 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.824934 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825071 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825322 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825466 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825589 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825777 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.825877 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826088 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826186 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826398 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826584 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826707 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.826797 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827024 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827115 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827342 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827464 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827668 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827757 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.827966 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828062 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828282 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828371 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828582 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828677 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.828910 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829001 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829243 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829341 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829585 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829681 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.829944 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830034 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830113 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830552 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830643 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830739 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.830819 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.831240 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.831331 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.831410 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.831508 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.831599 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832081 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832171 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832248 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832325 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832402 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832855 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.832954 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833033 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833118 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833198 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833281 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833836 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.833927 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834005 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834081 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834158 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834246 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834787 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834884 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.834964 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835048 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835126 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835210 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835289 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835806 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.835940 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.836026 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.836117 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.836211 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.836444 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.836541 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.837460 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.837685 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.837770 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.837865 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.837953 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838032 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838115 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838194 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838276 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838369 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838449 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838526 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838602 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838679 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838767 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838846 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.838922 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840206 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840547 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840638 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840802 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840893 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.840973 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841056 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841140 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841217 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841306 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841385 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841461 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841537 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841613 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841694 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841780 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841859 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.841935 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.842011 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.842087 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.842162 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.842250 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.843863 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.843957 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.843957 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844097 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844192 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844278 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844357 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844433 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844516 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844594 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844679 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844757 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844833 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844909 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.844985 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.845060 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.845148 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.845232 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.845315 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.845393 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.846970 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847061 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847149 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847229 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847306 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847382 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.847958 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848056 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848146 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848225 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848301 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848385 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848463 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848547 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848626 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848709 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848787 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848863 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.848939 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849022 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849106 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849190 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849268 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849347 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849424 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849508 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849587 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849663 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849739 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.849814 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.851690 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.851816 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.851900 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.851987 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852066 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852151 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852230 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852315 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852395 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852478 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852557 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852633 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852718 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852796 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852880 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.852957 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.853033 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.853109 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.853194 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.853278 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.854817 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.854912 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.854990 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.855067 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.855473 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.855755 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.855963 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.856160 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.856357 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.856564 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.856787 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.857083 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.857289 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.857534 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.857698 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.857911 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.858121 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.858324 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.858528 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.858724 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.858922 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.859132 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.859348 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.859562 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.859769 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.859968 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.860163 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.860163 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.860755 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.860930 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.861130 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.861334 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.861537 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.861746 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.861955 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.862152 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.862355 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.862557 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.862752 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.862958 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.863163 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.863361 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.863522 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.863717 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.863924 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.864143 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.864328 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.864530 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.864739 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.864942 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.865148 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.865353 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.865546 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.865810 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.865810 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.866200 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.866410 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.866615 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.866872 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.867675 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.867880 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868079 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868294 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868451 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868587 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868798 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.868928 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869050 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869211 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869383 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869568 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869752 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.869902 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870031 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870161 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870284 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870405 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870534 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870668 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.870925 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.871061 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.871183 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.871599 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.871745 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.871869 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872000 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872129 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872257 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872379 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872500 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872619 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872752 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.872875 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873002 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873124 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873244 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873444 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873569 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873690 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873810 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.873938 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874061 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874189 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874309 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874435 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874557 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874678 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874805 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.874935 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875063 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875227 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875350 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875486 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875602 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875735 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.875934 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876059 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876178 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876299 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876426 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876561 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876683 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876804 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.876924 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877044 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877044 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877290 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877412 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877532 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877744 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.877876 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878008 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878130 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878251 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878379 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878509 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878630 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878752 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878881 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.878995 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879121 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879250 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879250 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879250 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879683 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879808 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.879808 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880048 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880173 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880300 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880431 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880552 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880672 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.880793 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881040 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881166 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881300 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881562 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881688 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881810 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.881944 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.882066 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.882186 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.882306 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.882426 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.882566 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.883280 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.883411 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.883592 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.883863 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884005 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884127 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884257 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884390 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884512 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884633 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884754 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.884874 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885003 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885133 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885133 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885359 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885480 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885601 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885723 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885723 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.885965 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886163 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886289 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886424 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886546 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886674 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886795 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.886916 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887036 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887165 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887293 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887414 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887581 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887702 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.887912 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888046 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888169 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888290 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888290 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888546 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888546 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888784 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.888784 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889012 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889133 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889261 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889391 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889512 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889639 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889761 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.889908 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890038 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890172 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890295 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890415 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890535 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890655 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890775 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.890903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891166 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891309 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891457 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891581 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891728 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891852 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.891986 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892108 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892227 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892356 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892484 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892605 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892733 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892854 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.892974 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893115 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893363 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893520 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893652 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893775 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.893896 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894017 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894203 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894343 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894539 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894662 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894782 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894910 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.894910 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895165 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895313 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895485 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895621 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895750 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.895872 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896006 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896142 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896298 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896420 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896549 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896671 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896799 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.896927 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897060 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897166 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897286 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897408 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897536 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897536 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897766 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.897900 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898085 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898273 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898413 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898541 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898664 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898810 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.898932 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899064 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899186 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899306 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899440 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899562 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899683 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899820 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.899942 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900069 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900194 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900314 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900442 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900575 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900697 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900823 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.900944 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901064 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901322 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901454 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901576 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901706 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901838 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.901965 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902094 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902215 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902335 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902455 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902575 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902695 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902824 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.902944 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903070 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903192 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903312 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903546 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903685 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903815 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.903937 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904064 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904185 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904305 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904434 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904555 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904676 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904803 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.904976 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905103 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905287 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905414 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905597 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905729 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.905903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906037 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906205 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906330 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906558 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906688 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906817 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.906949 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907107 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907232 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907413 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907572 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907737 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.907876 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908038 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908246 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908371 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908491 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908619 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908749 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.908920 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909046 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909225 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909349 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909550 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909675 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.909871 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910001 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910179 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910308 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910475 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910615 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910781 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.910907 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.911097 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.911366 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.911563 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.911722 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.911722 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912029 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912160 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912281 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912410 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912532 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912659 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912780 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.912969 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913094 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913282 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913415 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913613 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913750 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.913903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914035 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914220 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914408 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914538 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914658 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914836 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.914972 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.915093 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.915212 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.915456 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.915590 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916002 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916164 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916164 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916398 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916489 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916600 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916681 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916766 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.916961 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917048 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917288 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917443 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917620 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917754 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.917932 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918063 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918249 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918390 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918562 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918695 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.918876 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919019 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919196 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919324 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919644 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919748 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.919962 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920056 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920289 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920384 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920613 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920706 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.920923 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921025 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921237 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921388 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921560 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921740 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.921909 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922104 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922261 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922425 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922567 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922748 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.922909 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923068 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923226 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923389 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923593 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923803 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.923965 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.924142 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.924298 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.924493 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.924665 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.924836 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925004 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925004 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925315 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925485 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925645 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925798 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.925964 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.926135 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.926572 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.926732 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.926903 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927043 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927195 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927334 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927527 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927671 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927833 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.927980 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928133 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928284 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928284 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928562 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928713 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.928864 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.929003 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.929147 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.929298 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.929980 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.930213 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.930433 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.930433 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.930903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.931190 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.931504 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.931827 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.932038 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.932270 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.932731 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.932951 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.933129 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.933280 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.933420 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.933558 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.933868 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934046 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934196 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934417 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934566 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934717 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934857 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.934994 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.935140 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.935278 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.935473 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.935741 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.935891 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936054 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936232 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936377 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936515 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936661 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936814 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.936988 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.937143 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.937314 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.937462 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.937763 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.937911 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938050 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938200 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938339 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938478 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938625 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938771 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.938934 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939074 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939219 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939358 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939529 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939670 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.939854 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940076 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940220 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940418 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940574 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940716 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.940878 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941030 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941183 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941375 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941522 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941679 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941838 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.941982 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.942134 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.942337 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.942533 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.942689 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.942865 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943058 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943212 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943354 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943532 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943686 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.943826 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944055 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944201 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944347 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944486 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944632 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944772 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.944911 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.945128 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.945773 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.945916 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946091 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946381 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946536 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946676 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946815 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.946954 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947126 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947270 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947590 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947754 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.947910 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.948066 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.948901 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949076 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949222 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949222 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949222 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949637 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949803 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.949946 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950101 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950241 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950241 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950569 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950714 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.950857 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951008 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951154 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951311 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951484 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951644 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951783 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.951928 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952083 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952239 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952411 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952560 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952714 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.952878 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953040 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953192 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953376 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953526 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953679 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953835 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.953988 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.954237 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.954411 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.954411 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.954703 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.954862 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955010 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955149 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955289 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955445 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955590 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955744 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.955891 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956030 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956167 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956317 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956460 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956607 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956754 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.956894 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957039 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957178 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957326 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957472 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957617 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957756 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.957892 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958040 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958186 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958325 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958476 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958615 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958753 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.958890 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959039 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959185 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959324 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959502 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959647 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959796 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.959950 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.960096 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.960251 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.960401 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.960554 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.961230 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.961393 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.961625 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.961787 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.961928 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962081 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962229 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962400 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962539 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962699 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.962846 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963051 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963206 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963371 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963564 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963730 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.963871 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964030 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964285 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964441 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964593 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964732 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.964928 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965161 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965324 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965464 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965616 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965763 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.965915 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966067 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966220 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966369 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966522 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966675 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966814 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.966959 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967099 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967236 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967380 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967610 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967768 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.967946 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968095 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968248 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968401 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968564 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968787 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.968941 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969139 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969283 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969422 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969583 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969736 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.969940 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970086 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970276 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970420 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970565 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970725 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.970943 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.971166 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.971378 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.971615 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.971830 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.972059 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.972271 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.972475 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.972686 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.972891 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973046 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973198 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973336 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973484 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973625 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973770 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.973917 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974056 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974056 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974377 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974602 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974756 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.974905 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975056 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975195 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975340 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975561 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975776 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.975927 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.976066 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.976218 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.976953 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977176 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977380 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977536 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977700 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977875 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.977875 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978180 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978343 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978506 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978665 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978831 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.978983 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.979157 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.979327 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.979511 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.979697 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.979876 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980053 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980053 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980386 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980548 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980716 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.980880 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981040 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981220 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981401 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981583 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981747 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.981914 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.982087 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983003 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983172 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983325 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983530 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983680 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983680 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.983991 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984154 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984623 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984623 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.984623 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985201 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985368 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985469 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985552 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985661 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985774 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985861 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.985963 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986058 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986158 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986158 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986351 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986458 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986541 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986644 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986644 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986846 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.986945 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987029 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987139 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987237 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987356 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987467 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987590 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987684 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.987903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.988178 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.988449 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.988557 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.988766 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.988870 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989079 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989182 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989420 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989539 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989739 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.989844 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990057 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990160 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990376 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990482 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990690 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.990782 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.991000 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.991121 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.991311 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.991449 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.991651 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992004 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992100 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992326 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992441 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992642 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992771 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.992967 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993073 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993287 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993428 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993603 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993864 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.993974 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.994180 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.994303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.994503 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.994638 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.994852 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995019 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995161 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995274 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995492 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995621 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995817 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.995925 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996134 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996226 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996444 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996529 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996754 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.996838 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997066 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997158 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997387 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997473 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997701 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.997788 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998020 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998106 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998334 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998426 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998688 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998830 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.998957 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:12.999227 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.000752 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.000859 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.000976 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001076 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001183 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001291 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001379 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001476 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001574 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001681 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001776 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001874 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.001958 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002044 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002136 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002287 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002391 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002489 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002573 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002651 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002753 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002841 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.002927 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003017 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003129 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003222 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003361 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003561 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003733 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.003869 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004079 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004191 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004435 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004529 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004783 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.004874 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005096 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005187 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005399 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005490 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005784 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.005895 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006007 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006100 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006329 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006647 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006748 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.006957 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.007059 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.007272 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.007375 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.007662 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.007812 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008011 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008129 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008388 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008560 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008701 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.008882 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009011 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009235 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009362 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009545 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009648 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009870 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.009975 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010194 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010298 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010517 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010609 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010846 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.010949 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011163 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011268 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011499 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011610 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011815 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.011944 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.012088 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 13:02:13.012180 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.012435 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.012772 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.013089 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.013399 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.013832 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.014149 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.014471 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.014871 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.015116 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.015461 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.015793 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.016111 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.016436 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.016755 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.017089 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.017572 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.017759 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.018094 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.018572 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.018706 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.019015 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.019333 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.019804 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.020125 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.020462 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.020779 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.021109 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.021424 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.021752 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.022100 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.022405 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.022722 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.023057 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.023915 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.024232 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.024585 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.024902 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.025217 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.025533 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.025865 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.026197 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.026509 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.026841 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.027161 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.027508 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.027830 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.028143 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.028496 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.028791 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.029109 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.029422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.029742 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.030057 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.030548 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.030699 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.031029 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.031359 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.031729 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.032059 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.032389 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.032725 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.033188 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:02:13.033429 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 13:02:13.035596 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_db.sqlalchemy.engines [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.056908 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.232077 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.context [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6b54549-b926-49af-b381-631339695cfe(cell1) {{(pid=94143) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 13:02:13.234829 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.context [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6b54549-b926-49af-b381-631339695cfe(cell1) {{(pid=94144) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 13:02:13.236536 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_concurrency.lockutils [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:02:13.238153 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_concurrency.lockutils [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:02:13.238983 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_concurrency.lockutils [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:02:13.239154 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:02:13.240779 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:02:13.240953 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_concurrency.lockutils [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:02:13.241597 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:02:13.243654 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:02:13.252600 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.254446 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.256105 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_db.sqlalchemy.engines [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.261450 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_db.sqlalchemy.engines [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.521144 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:13.531825 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_db.sqlalchemy.engines [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:02:14.021078 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: WARNING keystonemiddleware.auth_token [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:02:14.028393 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: WARNING keystonemiddleware.auth_token [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:02:14.042120 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: WARNING keystonemiddleware.auth_token [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:02:14.048512 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: WARNING keystonemiddleware.auth_token [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:02:14.387158 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: WARNING keystonemiddleware.auth_token [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:02:14.392482 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: WARNING keystonemiddleware.auth_token [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:02:14.398737 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55728f09b9c0 pid: 94143 (default app) Sep 22 13:02:14.400856 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:02:14.402037 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Sep 22 13:02:14.402447 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 789 bytes} [Wed Sep 22 13:02:14 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:02:14.402550 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: WARNING keystonemiddleware.auth_token [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:02:14.407688 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: WARNING keystonemiddleware.auth_token [None req-cba8fd5c-cc84-4b53-ac52-64f3732c453d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:02:14.416892 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55728f09b9c0 pid: 94144 (default app) Sep 22 13:03:41.583140 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:41.584170 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Sep 22 13:03:41.584578 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:03:42.071071 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-45b86156-57dd-4f7c-8e0b-347f234f23f8 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:42.110000 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-45b86156-57dd-4f7c-8e0b-347f234f23f8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.514814 Sep 22 13:03:42.111896 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Sep 22 13:03:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:03:44.400961 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:44.401916 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-1d0a1a79-9e62-4c48-a7c3-3ea39e06c012 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 22 13:03:44.405903 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:44 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:03:44.507854 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-63b1d5fc-5978-42af-859c-e918ebe7e600 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:44.531044 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:03:44.531044 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:03:44.640629 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-63b1d5fc-5978-42af-859c-e918ebe7e600 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.228294 Sep 22 13:03:44.640910 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:03:44 2021] POST /compute/v2.1/flavors => generated 407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:03:44.870329 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-913a7f07-f6eb-477d-ae2d-3aafd739c295 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:44.872972 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:03:44.872972 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: warnings.warn(msg) Sep 22 13:03:45.009357 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-913a7f07-f6eb-477d-ae2d-3aafd739c295 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359288 Sep 22 13:03:45.010422 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Sep 22 13:03:44 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:03:47.312136 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-63b1d5fc-5978-42af-859c-e918ebe7e600 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:47.313226 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-63b1d5fc-5978-42af-859c-e918ebe7e600 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002813 Sep 22 13:03:47.313740 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:47 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:03:47.452759 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-5320e30e-2584-4742-bb84-983a1aaae4fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "ram": 512, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:47.471373 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:03:47.471373 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: warnings.warn(msg) Sep 22 13:03:47.594225 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-5320e30e-2584-4742-bb84-983a1aaae4fd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.272951 Sep 22 13:03:47.594803 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:03:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:03:47.609058 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-1548d670-f2a4-432e-8c37-e213c3747de7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:47.610393 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:03:47.610393 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:03:47.729246 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-1548d670-f2a4-432e-8c37-e213c3747de7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124728 Sep 22 13:03:47.730256 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Sep 22 13:03:47 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:03:50.704403 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-5320e30e-2584-4742-bb84-983a1aaae4fd admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:50.706100 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-5320e30e-2584-4742-bb84-983a1aaae4fd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Sep 22 13:03:50.706699 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:03:50.778390 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-febcc49a-c963-4f6b-9f6a-0026faef839c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:50.887665 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-febcc49a-c963-4f6b-9f6a-0026faef839c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.173321 Sep 22 13:03:50.888843 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:03:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:03:50.903661 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-dccf73a8-1ce8-48ad-a8c7-196cb9c13ff9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:50.997776 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-dccf73a8-1ce8-48ad-a8c7-196cb9c13ff9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098447 Sep 22 13:03:50.999036 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Sep 22 13:03:50 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:03:53.320346 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-febcc49a-c963-4f6b-9f6a-0026faef839c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:53.321366 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-febcc49a-c963-4f6b-9f6a-0026faef839c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 22 13:03:53.321779 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:03:53.386490 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-7bf3437e-203f-41fd-b471-4432771731ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:53.465429 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-7bf3437e-203f-41fd-b471-4432771731ed admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135420 Sep 22 13:03:53.465990 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:03:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:03:53.479392 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-1f2deb36-f303-4a01-afd2-2765eae46cc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:53.587333 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-1f2deb36-f303-4a01-afd2-2765eae46cc2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111596 Sep 22 13:03:53.588061 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Sep 22 13:03:53 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:03:55.863106 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-7bf3437e-203f-41fd-b471-4432771731ed admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:55.864170 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-7bf3437e-203f-41fd-b471-4432771731ed admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 22 13:03:55.864570 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:03:55.930283 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:56.008035 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136411 Sep 22 13:03:56.008792 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:03:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:03:56.021419 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-b111922d-b84f-4ce7-9653-a8c3aa21adfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:03:56.132551 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-b111922d-b84f-4ce7-9653-a8c3aa21adfb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114785 Sep 22 13:03:56.133168 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Sep 22 13:03:56 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:03:58.435101 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:58.436434 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Sep 22 13:03:58.437166 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:03:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:03:58.501363 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-f9926227-830c-4b4b-bbd2-03d0ee00afc3 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:03:58.527116 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-f9926227-830c-4b4b-bbd2-03d0ee00afc3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082956 Sep 22 13:03:58.527771 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Sep 22 13:03:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:00.774133 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:00.775154 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-366dcd51-9f13-480b-bda9-eb8a58d34faf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 22 13:04:00.775605 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:00.836894 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2236072c-ef23-4006-90e5-5997258c8280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:00.945533 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2236072c-ef23-4006-90e5-5997258c8280 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.163116 Sep 22 13:04:00.945989 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:04:00 2021] POST /compute/v2.1/flavors => generated 402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:04:00.958702 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-c48773a3-9bae-4751-8d9c-22b743f457cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:01.065273 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-c48773a3-9bae-4751-8d9c-22b743f457cf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110092 Sep 22 13:04:01.066044 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Sep 22 13:04:00 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:04:03.320474 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2236072c-ef23-4006-90e5-5997258c8280 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:03.321588 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2236072c-ef23-4006-90e5-5997258c8280 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 22 13:04:03.322076 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:03.385103 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-453723e7-8718-4ff0-8779-7ee460849235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:03.464755 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-453723e7-8718-4ff0-8779-7ee460849235 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133757 Sep 22 13:04:03.465325 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:04:03 2021] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:04:03.477977 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-c834f004-e167-4d34-9c09-42540f6d5711 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:03.579294 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-c834f004-e167-4d34-9c09-42540f6d5711 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104073 Sep 22 13:04:03.579892 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Sep 22 13:04:03 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:04:05.898179 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-453723e7-8718-4ff0-8779-7ee460849235 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:05.899338 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-453723e7-8718-4ff0-8779-7ee460849235 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Sep 22 13:04:05.899986 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:05.962882 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-83c39d1b-7583-430c-8d11-98d5c44fb625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:06.042303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-83c39d1b-7583-430c-8d11-98d5c44fb625 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.134534 Sep 22 13:04:06.043123 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:04:05 2021] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:04:06.055488 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-92a5641c-b0ef-4ae4-9220-a14aafd55e53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:06.164214 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-92a5641c-b0ef-4ae4-9220-a14aafd55e53 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112129 Sep 22 13:04:06.175671 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Sep 22 13:04:06 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:04:08.465032 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-83c39d1b-7583-430c-8d11-98d5c44fb625 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:08.466718 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-83c39d1b-7583-430c-8d11-98d5c44fb625 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Sep 22 13:04:08.467294 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:08.538762 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-a0dbc8da-f357-43c1-9929-f22a8a029a56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "disk": 80, "swap": 0, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:08.637313 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-a0dbc8da-f357-43c1-9929-f22a8a029a56 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.163138 Sep 22 13:04:08.637877 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:04:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:04:08.650198 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-e4db4133-2047-44a1-b574-91cbcac3555c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:08.745224 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-e4db4133-2047-44a1-b574-91cbcac3555c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098629 Sep 22 13:04:08.745788 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Sep 22 13:04:08 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:04:11.160748 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-a0dbc8da-f357-43c1-9929-f22a8a029a56 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:11.161767 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-a0dbc8da-f357-43c1-9929-f22a8a029a56 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 22 13:04:11.165953 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:11.233625 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:11.335222 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.165475 Sep 22 13:04:11.335729 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Sep 22 13:04:11 2021] POST /compute/v2.1/flavors => generated 408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:04:11.348698 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-c987b4b6-552c-48fe-8252-f0d9e582a6cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:11.448745 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-c987b4b6-552c-48fe-8252-f0d9e582a6cd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103638 Sep 22 13:04:11.449348 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Sep 22 13:04:11 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:04:52.907570 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:52.913374 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 22 13:04:52.913374 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:04:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:52.969074 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-ab60041b-1649-4b92-9491-30d734069f8b admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:52.986115 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-ab60041b-1649-4b92-9491-30d734069f8b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070412 Sep 22 13:04:52.986657 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Sep 22 13:04:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:54.446494 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:54.447531 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-6ca27ce3-6b6b-4afa-8c50-963f3e5a9bb1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 22 13:04:54.447943 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:04:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:54.640032 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-004de26c-bc78-4a55-9c8b-8714ae4519f2 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:54.645491 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.wsgi [None req-004de26c-bc78-4a55-9c8b-8714ae4519f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 13:04:54.646053 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-004de26c-bc78-4a55-9c8b-8714ae4519f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:54.646902 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-004de26c-bc78-4a55-9c8b-8714ae4519f2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059842 Sep 22 13:04:54.647414 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Sep 22 13:04:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 22 13:04:54.658125 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-191d8bfc-3924-4ea4-a15b-6b83d46fcebc admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:54.679444 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-191d8bfc-3924-4ea4-a15b-6b83d46fcebc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025521 Sep 22 13:04:54.680038 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:54.691178 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-9a031d22-d614-4b09-87e0-c66645916249 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:54.711957 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-9a031d22-d614-4b09-87e0-c66645916249 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024869 Sep 22 13:04:54.712607 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:04:54.723176 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-add1540f-1a5b-4ed2-b0ab-158cec368da7 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:54.728743 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.wsgi [None req-add1540f-1a5b-4ed2-b0ab-158cec368da7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 13:04:54.729303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-add1540f-1a5b-4ed2-b0ab-158cec368da7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:54.730086 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-add1540f-1a5b-4ed2-b0ab-158cec368da7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010484 Sep 22 13:04:54.730587 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Sep 22 13:04:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 13:04:56.109705 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-9a031d22-d614-4b09-87e0-c66645916249 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:56.110707 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-9a031d22-d614-4b09-87e0-c66645916249 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 22 13:04:56.111100 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:04:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:56.304889 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-27d8fb9a-6425-479c-9ec8-a535234736ff admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:56.310629 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.wsgi [None req-27d8fb9a-6425-479c-9ec8-a535234736ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 13:04:56.311203 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-27d8fb9a-6425-479c-9ec8-a535234736ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:56.312085 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-27d8fb9a-6425-479c-9ec8-a535234736ff admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060026 Sep 22 13:04:56.312597 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Sep 22 13:04:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 13:04:56.322715 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-810052a2-ea0a-45bd-bd25-e9d765ea81d6 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:56.336675 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-810052a2-ea0a-45bd-bd25-e9d765ea81d6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017813 Sep 22 13:04:56.337264 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:56.348020 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-f7647258-8da9-41ee-b2f6-1634ff6ccd92 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:56.361783 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-f7647258-8da9-41ee-b2f6-1634ff6ccd92 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017770 Sep 22 13:04:56.362314 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:56.372083 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-16abbd98-c59f-4a04-a132-f474872b815f admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:56.377688 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.wsgi [None req-16abbd98-c59f-4a04-a132-f474872b815f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 13:04:56.378241 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-16abbd98-c59f-4a04-a132-f474872b815f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:56.379011 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-16abbd98-c59f-4a04-a132-f474872b815f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010488 Sep 22 13:04:56.379524 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Sep 22 13:04:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 22 13:04:57.731834 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-f7647258-8da9-41ee-b2f6-1634ff6ccd92 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:57.732841 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-f7647258-8da9-41ee-b2f6-1634ff6ccd92 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 22 13:04:57.733903 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:04:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:57.923273 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-8d2c8e31-c76e-4bb9-a854-eb4c726cb3b4 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:57.929231 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.wsgi [None req-8d2c8e31-c76e-4bb9-a854-eb4c726cb3b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 13:04:57.929803 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-8d2c8e31-c76e-4bb9-a854-eb4c726cb3b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:57.930601 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-8d2c8e31-c76e-4bb9-a854-eb4c726cb3b4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060785 Sep 22 13:04:57.931119 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:04:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 13:04:57.941469 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-69a8fc69-09b5-4c1c-96eb-4638f8055067 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:57.954767 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-69a8fc69-09b5-4c1c-96eb-4638f8055067 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016778 Sep 22 13:04:57.955298 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:04:57.965114 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:57.978285 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016598 Sep 22 13:04:57.978822 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Sep 22 13:04:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:04:57.989326 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-73ed8a59-5c1d-4e2c-9194-9aa0ad748405 admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:57.994466 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.wsgi [None req-73ed8a59-5c1d-4e2c-9194-9aa0ad748405 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 13:04:57.995025 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-73ed8a59-5c1d-4e2c-9194-9aa0ad748405 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:04:57.995841 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-73ed8a59-5c1d-4e2c-9194-9aa0ad748405 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010071 Sep 22 13:04:57.996367 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:04:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 13:04:59.368981 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:04:59.370068 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 22 13:04:59.370460 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:04:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:04:59.567829 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-63a27713-ea38-4d09-9e8c-ceca0580824e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:04:59.690647 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-63a27713-ea38-4d09-9e8c-ceca0580824e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.181304 Sep 22 13:04:59.691391 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Sep 22 13:04:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:05:01.074378 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:01.075378 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 22 13:05:01.075798 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:05:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:05:01.266031 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-4e8f8c18-f486-4d67-b4ec-32a317d0149e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:05:01.381335 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-4e8f8c18-f486-4d67-b4ec-32a317d0149e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.166045 Sep 22 13:05:01.381802 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Sep 22 13:05:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:05:02.743552 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:02.744635 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 22 13:05:02.745035 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:05:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:05:02.936326 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-3b1db757-4319-4770-ba35-4b31d54a1230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:05:03.028277 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-3b1db757-4319-4770-ba35-4b31d54a1230 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.144193 Sep 22 13:05:03.028833 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Sep 22 13:05:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:05:04.399283 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:04.400308 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 22 13:05:04.411663 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:05:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:05:04.603939 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-c9ce87dd-a315-49b5-8618-2172b4ae13c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:05:04.730935 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-c9ce87dd-a315-49b5-8618-2172b4ae13c4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.183078 Sep 22 13:05:04.731532 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Sep 22 13:05:04 2021] POST /compute/v2.1/flavors => generated 409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:05:06.106480 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:06.107649 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 22 13:05:06.108046 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:05:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:05:06.302165 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-6e96a37d-c7df-4175-97f8-3cf02d7309db admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:06.321456 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-6e96a37d-c7df-4175-97f8-3cf02d7309db admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072749 Sep 22 13:05:06.321913 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1203 bytes} [Wed Sep 22 13:05:06 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:05:53.559733 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.560732 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-346d504f-7dc0-40ce-a557-bffa3500042c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 22 13:05:53.561127 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:05:53.625791 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-1dd9f50d-6b7d-489f-bb95-f8d7c752534c admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.644616 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-1dd9f50d-6b7d-489f-bb95-f8d7c752534c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075490 Sep 22 13:05:53.645176 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:05:53.668542 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-80715252-d057-451a-91c0-acc2c866d0b1 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.677676 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-80715252-d057-451a-91c0-acc2c866d0b1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013002 Sep 22 13:05:53.678249 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:05:53.691013 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-462ec39a-ce5a-4faa-b9e6-f653f3bba65f admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.699088 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-462ec39a-ce5a-4faa-b9e6-f653f3bba65f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011869 Sep 22 13:05:53.699691 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:05:53.713430 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-3eed15b8-a2ea-4c5f-b9c0-b8e6990fb807 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.722124 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-3eed15b8-a2ea-4c5f-b9c0-b8e6990fb807 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012341 Sep 22 13:05:53.722689 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:05:53.735744 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:05:53.743590 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012018 Sep 22 13:05:53.744173 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Wed Sep 22 13:05:53 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:07:26.683479 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-85a0870b-4d7f-4176-86cf-263b050603aa tempest-verify_tempest_config-426836067 tempest-verify_tempest_config-426836067-project] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:07:26.685558 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-85a0870b-4d7f-4176-86cf-263b050603aa tempest-verify_tempest_config-426836067 tempest-verify_tempest_config-426836067-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106860 Sep 22 13:07:26.686092 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Sep 22 13:07:26 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:09:02.111760 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:02.112778 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 22 13:09:02.113177 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:09:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:09:02.378059 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:02.379190 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:09:02.379190 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:09:02.380750 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:02.381186 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:02.381990 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:02.382414 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:02.416217 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-7f6518eb-d068-4306-a9ca-0066cc72cb8a admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157010 Sep 22 13:09:02.416782 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:09:02 2021] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:09:03.814816 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:03.816261 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Sep 22 13:09:03.835146 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:09:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:09:04.019188 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:04.020344 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:09:04.020344 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:09:04.021844 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:04.022281 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:04.023052 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:04.023548 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:04.049274 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-1598f838-c158-4d1e-840d-a3205ddd772d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087927 Sep 22 13:09:04.052752 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 36/73] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:09:03 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:09:15.905334 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:15.906339 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 22 13:09:15.906719 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:09:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:09:16.105828 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:16.106966 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:09:16.106966 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:09:16.108552 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:16.109014 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:16.109808 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:16.110213 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:16.131998 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-7b6382cf-81ff-4785-9efb-1d4221a2332f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079809 Sep 22 13:09:16.132561 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 37/75] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:09:16 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:09:17.508328 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: DEBUG nova.api.openstack.wsgi [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] Calling method '>' {{(pid=94143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:17.509348 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: INFO nova.api.openstack.requestlog [None req-2ddcdb5c-c437-46f3-ac3c-26befaaa5f3b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 22 13:09:17.509749 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: [pid: 94143|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Sep 22 13:09:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:09:17.703903 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG nova.api.openstack.wsgi [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] Calling method '>' {{(pid=94144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:09:17.705052 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:09:17.705052 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: warnings.warn(msg) Sep 22 13:09:17.706538 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:17.706978 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:17.707793 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:09:17.708219 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: DEBUG oslo_concurrency.lockutils [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:09:17.728739 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: INFO nova.api.openstack.requestlog [None req-65a9d17a-6d53-4737-83fe-5ca227d8e006 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077400 Sep 22 13:09:17.729352 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: [pid: 94144|app: 0|req: 38/77] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Sep 22 13:09:17 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:10:15.381675 dv-cinder-810000-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 22 13:10:15.382850 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: Wed Sep 22 13:10:15 2021 - graceful shutdown triggered... Sep 22 13:10:15.383303 dv-cinder-810000-3-iscsi devstack@n-api.service[94143]: Gracefully killing worker 1 (pid: 94143)... Sep 22 13:10:15.384125 dv-cinder-810000-3-iscsi devstack@n-api.service[94144]: Gracefully killing worker 2 (pid: 94144)... Sep 22 13:10:16.384035 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: worker 1 buried after 1 seconds Sep 22 13:10:16.384035 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: worker 2 buried after 1 seconds Sep 22 13:10:16.384035 dv-cinder-810000-3-iscsi devstack@n-api.service[94142]: goodbye to uWSGI. Sep 22 13:10:16.385612 dv-cinder-810000-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 22 13:10:16.386188 dv-cinder-810000-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 22 13:10:16.389037 dv-cinder-810000-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 13:10:16.399291 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 22 13:10:16 2021] *** Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: nodename: dv-cinder-810000-3-iscsi Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: machine: x86_64 Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: clock source: unix Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: pcre jit disabled Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: detected number of CPU cores: 4 Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: current working directory: / Sep 22 13:10:16.401332 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: detected binary path: /usr/bin/uwsgi-core Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: your processes number limit is 47680 Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: your memory page size is 4096 bytes Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: detected max file descriptor number: 2048 Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: lock engine: pthread robust mutexes Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: thunder lock: enabled Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 13:10:16.401990 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 22 13:10:16.449167 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: Python main interpreter initialized at 0x55caba1439c0 Sep 22 13:10:16.449167 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: python threads support enabled Sep 22 13:10:16.449167 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: your server socket listen backlog is limited to 100 connections Sep 22 13:10:16.449167 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: your mercy for graceful operations on workers is 90 seconds Sep 22 13:10:16.449630 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 13:10:16.449630 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: *** Operational MODE: preforking *** Sep 22 13:10:16.449907 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: *** uWSGI is running in multiple interpreter mode *** Sep 22 13:10:16.449907 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: spawned uWSGI master process (pid: 109149) Sep 22 13:10:16.450113 dv-cinder-810000-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 13:10:16.450688 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: spawned uWSGI worker 1 (pid: 109167, cores: 1) Sep 22 13:10:16.451230 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: spawned uWSGI worker 2 (pid: 109168, cores: 1) Sep 22 13:10:16.451598 dv-cinder-810000-3-iscsi devstack@n-api.service[109149]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 13:10:18.309863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:10:18.309863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: from cryptography.utils import int_from_bytes Sep 22 13:10:18.310567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:10:18.310567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: from cryptography.utils import int_from_bytes Sep 22 13:10:18.310697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:10:18.310697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: from cryptography.utils import int_from_bytes Sep 22 13:10:18.310697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 13:10:18.310697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: from cryptography.utils import int_from_bytes Sep 22 13:10:21.018999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 13:10:21.019723 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 13:10:21.019814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 13:10:21.019814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 13:10:21.020237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 13:10:21.020237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 13:10:21.020381 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 13:10:21.020464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 13:10:21.020825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 13:10:21.020927 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021012 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 13:10:21.021083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021678 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.021921 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.022020 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.022252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.022378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.023183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.023352 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.023537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.023701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.024980 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810000-3-iscsi {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025558 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810000-3-iscsi {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.025899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.026919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027084 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027572 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.027937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.029436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.029684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.029903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.030114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.030329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.030546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.030761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.030975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.031191 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.031390 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.031612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.031815 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.032027 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.032245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.032245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.032676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.032676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810000-3-iscsi {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.033892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.034290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810000-3-iscsi {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.034977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.035135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.035307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.035518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.035518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.036298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.036298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.036601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.036754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.036907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.037484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.037647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.037797 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.037939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.038194 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.038449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.038596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.038753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.038894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039550 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.039853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040686 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.040997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.041137 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.041285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.041434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.041434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.041711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042755 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.042755 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.043972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044288 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044437 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044585 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.044868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.045251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.045401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.045548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.045697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.045865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.046308 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.046468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.046637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.046786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.046937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.047084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.047703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.047864 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048433 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.048891 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.049044 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.049203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.049545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.049711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.049862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.050886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051344 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.051949 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052243 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052586 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.052885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053190 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.053798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054214 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.054957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.055099 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.055599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.055755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.055907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.056057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.056545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.056701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.056844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.056993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.057133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.057282 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.057933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058244 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058399 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.058858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.059784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.060952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.061833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062214 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062353 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062784 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.062932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063383 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.063851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.064894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065676 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.065978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.066136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.066284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.066694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.066850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.067002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.067157 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.067299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.067670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.067852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.068920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.069069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.069742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.069892 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070042 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070191 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.070955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071098 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071412 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071733 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.071881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.072022 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.072162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.072310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.072451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 13:10:21.072599 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.072748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.072895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.073998 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074738 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.074878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.075177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.075326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.075676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.075832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.075987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076136 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076284 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.076830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.077386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.077548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.077907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.078067 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.078471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.078628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.078771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.078913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.079987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080253 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080253 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.080846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.081987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082555 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082703 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.082851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083149 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.083873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084015 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084164 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.084767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.085528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.086028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.086182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.086325 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.086552 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.086959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.087119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.087262 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.087404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.087615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.087615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.088109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.088257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.088257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.088796 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.088945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.089120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.093564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095034 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.095880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096592 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.096917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.097079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.097220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.097368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.097964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098161 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.098960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.099837 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.099990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.100133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.100274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.100425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.100642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.100845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101239 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.101833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102583 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.102871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103020 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.103932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104361 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.104951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105550 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.105994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106136 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.106874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.107015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.107163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.107312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.107505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.108857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.109017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.109184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.109682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.109841 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.109985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110421 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110988 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.110988 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.111278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.111420 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.111669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.111835 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.111990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112433 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.112863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113440 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.113944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.114970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.115383 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.115613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.115756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.115903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116043 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.116948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.117103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.117259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.117416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.117574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.117731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.118291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.118454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.118611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.118774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.118931 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.119079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.119226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.119380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.119745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120160 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120755 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.120980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121492 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.121959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122723 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.122884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123042 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123198 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.123946 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.124890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.125941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126842 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.126995 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127788 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.127943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.128585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.128756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.128913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.129073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.129230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.129384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.129532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.129900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.130198 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.130361 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.130654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.130808 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.130963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.131120 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.131277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.131471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.131638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.132889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.133392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.133543 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.133692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.133834 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.133974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.134134 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.134294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.134454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.134600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.134815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.135973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136128 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.136910 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.137057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.137057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.137380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.137540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.138877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.139058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.139211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.139701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.140480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.140671 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.140981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141297 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141454 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.141919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142543 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.142862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143765 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.143914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144841 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.144993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.145272 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.145430 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.145586 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.145742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.145742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146033 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146485 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.146922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.147070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.147231 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.147407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.147407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.148356 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.148524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.148524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.149384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.149636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.149636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.149935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.150965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.151584 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.151754 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.151905 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.152053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.152212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.152370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.152517 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.152917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153069 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153218 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.153821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.154924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155017 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155111 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155111 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155792 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155876 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.155965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156860 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.156860 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157273 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.157950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158436 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.158963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159570 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.159930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160025 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160814 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160908 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.160999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161861 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.161945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162174 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162281 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162445 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162531 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.162867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163156 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163420 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163603 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163796 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.163948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164038 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164554 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164782 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.164942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165165 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165242 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165312 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165465 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.165988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166076 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166300 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166440 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166739 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.166806 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167213 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167289 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167678 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167891 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.167966 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168249 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168324 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168393 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168686 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.168999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169752 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.169972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170353 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170444 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170823 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.170899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171107 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171860 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.171962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.175568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.175680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.175770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.175855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.175937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176016 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176221 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176486 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.176948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177040 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177231 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177501 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177588 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177672 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177755 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.177933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178086 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178162 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178552 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178745 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178896 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.178967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179249 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179686 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179849 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.179928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180238 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.180960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181032 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181101 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181179 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.181981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182053 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.182975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183116 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.183414 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184068 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184602 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.184977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.185947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186157 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.186456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187515 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.187948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.188128 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.188454 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.188769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.188893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.189824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190043 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190767 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.190979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.191081 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.191302 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.191522 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.191719 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.191853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.192985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.193188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.193295 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.193718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.193911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.194070 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.194786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.194956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.195114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.195281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.195627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.195727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.195948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.196892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197760 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197860 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.197991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198141 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.198847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199041 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199348 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199478 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199688 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.199997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200098 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200402 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200616 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200719 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.200934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201242 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.201875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202034 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202485 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.202882 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.203132 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.203231 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.203487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.203596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.203925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204417 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204717 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.204840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205051 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.205816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206013 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.206943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.207074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.207380 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.207562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.207680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.207927 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208633 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208751 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.208876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.209016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.209312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.209417 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.209632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.209741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.210078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.210175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.210482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.210806 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.210976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211297 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.211965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.212925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213249 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213570 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.213923 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214175 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214428 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.214889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215215 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215727 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.215833 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216043 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216671 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.216984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217385 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.217913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218782 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.218876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219110 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.219847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.220999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221639 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221792 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.221942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.222956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.223876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.224102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.224383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.224562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.224718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.224868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.225022 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.225184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.225325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.225415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.226103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.226356 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.226663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.226770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.226995 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.227081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.227312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.227419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.227655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.227819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228004 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.228954 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.229932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230586 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.230887 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231572 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231737 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.231833 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232592 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.232922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233561 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.233858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.234874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235170 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235381 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235381 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235543 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.235801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236103 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236424 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236734 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.236943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237559 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237641 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.237907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.238178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.238288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.238636 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.238790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.238896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239021 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.239825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.240997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.241090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.242053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.242403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.242625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.247066 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.247317 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.247832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.247943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.248990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249087 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249174 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249354 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249354 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249603 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249784 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.249958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250041 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250317 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.250991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251060 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251418 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251775 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.251982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252476 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252567 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252864 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.252983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253561 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253561 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.253906 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254038 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.254943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255385 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255522 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.255989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.256196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.256510 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.256639 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.256798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.256926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.257015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.257127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.257436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.257771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.257905 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258402 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258770 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.258885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259320 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.259795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260437 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.260755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261609 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.261916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262224 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.262979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.263894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264231 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.264833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265366 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.265788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266442 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266774 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.266966 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267067 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267306 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267864 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.267954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268273 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268686 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.268983 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269327 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.269906 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270119 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270438 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.270849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271156 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271517 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.271827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272035 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.272996 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 13:10:21.273234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.273575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.273889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.274199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.274511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.274821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.275127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.275452 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.275784 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.276110 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.276417 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.276741 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.277059 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.277379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.277694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.278002 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.278328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.278637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.278949 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.279260 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.279653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.279923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.280237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.280563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.280887 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.281207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.281537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.281877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.282186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.282537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.282852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 13:10:21.283095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 13:10:21.299558 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.308833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_db.sqlalchemy.engines [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.382838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.context [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6b54549-b926-49af-b381-631339695cfe(cell1) {{(pid=109168) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 13:10:21.387495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:21.389100 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:21.389933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:21.391186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.context [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6b54549-b926-49af-b381-631339695cfe(cell1) {{(pid=109167) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 13:10:21.391964 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:21.395720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:21.398123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:21.398961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:21.400979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:21.403766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.404627 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.413666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_db.sqlalchemy.engines [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.415930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_db.sqlalchemy.engines [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.675645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_db.sqlalchemy.engines [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:21.687397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_db.sqlalchemy.engines [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 13:10:22.003452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:10:22.010866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:10:22.027536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: WARNING keystonemiddleware.auth_token [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:10:22.034258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: WARNING keystonemiddleware.auth_token [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:10:22.365839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:10:22.371775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: WARNING keystonemiddleware.auth_token [None req-541826a0-098b-4192-aea0-21c6eca64690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:10:22.376944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caba1439c0 pid: 109168 (default app) Sep 22 13:10:22.384379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: WARNING keystonemiddleware.auth_token [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 13:10:22.389804 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: WARNING keystonemiddleware.auth_token [None req-2b836d1d-3483-469c-bbcb-778861d04142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 13:10:22.394913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caba1439c0 pid: 109167 (default app) Sep 22 13:10:57.510119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-82cf81c4-3270-4406-a77c-8ef8fe6ec97e tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Action: 'create', calling method: .version_select at 0x7fa7190bd9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1950558523", "metadata": {"Type": "work"}}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:10:57.514459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-82cf81c4-3270-4406-a77c-8ef8fe6ec97e tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:57.514459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-82cf81c4-3270-4406-a77c-8ef8fe6ec97e tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.326712 Sep 22 13:10:57.514808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Sep 22 13:10:56 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:10:57.815626 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-34b4b299-6838-4c53-afb0-74fff0b7820d tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Action: 'create', calling method: .version_select at 0x7fa719107550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1613686578", "metadata": {"Type": "work"}}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:10:57.819360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-34b4b299-6838-4c53-afb0-74fff0b7820d tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:57.820532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-34b4b299-6838-4c53-afb0-74fff0b7820d tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.297998 Sep 22 13:10:57.821611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 1/2] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Sep 22 13:10:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:10:57.836541 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-591207b8-a5bf-40bd-b717-498b239cfb5a tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Action: 'create', calling method: .version_select at 0x7fa7190f0160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-232626516", "metadata": {"Type": "work"}}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:10:57.840831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-591207b8-a5bf-40bd-b717-498b239cfb5a tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:57.847385 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-591207b8-a5bf-40bd-b717-498b239cfb5a tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014942 Sep 22 13:10:57.850001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Sep 22 13:10:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:10:57.865183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9695734b-a246-4153-a5c5-e9b57326dec0 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Calling method '.version_select at 0x7fa719107d30>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:10:58.008785 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-693889521", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "5eacca51-cfa9-49d8-9462-091affedf979"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:10:58.268946 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-9695734b-a246-4153-a5c5-e9b57326dec0 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] HTTP exception thrown: Volume tempest-invalid-76982503 could not be found. Sep 22 13:10:58.271729 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9695734b-a246-4153-a5c5-e9b57326dec0 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 404 to user: Volume tempest-invalid-76982503 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:58.273642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9695734b-a246-4153-a5c5-e9b57326dec0 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-76982503" status: 404 len: 97 microversion: 2.1 time: 0.412261 Sep 22 13:10:58.276505 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1212 bytes} [Wed Sep 22 13:10:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-76982503 => generated 97 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 22 13:10:58.293104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-948efe8a-f2fc-4b30-9155-ebc46717cc52 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005023 Sep 22 13:10:58.293879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 4/5] 10.222.0.43 () {58 vars in 1140 bytes} [Wed Sep 22 13:10:58 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 22 13:10:58.306492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b459e25a-afd0-4b46-98e8-9908bb527158 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006334 Sep 22 13:10:58.310263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 5/6] 10.222.0.43 () {58 vars in 1137 bytes} [Wed Sep 22 13:10:58 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 22 13:10:58.320911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4ccf4ee7-19c4-4a01-9da5-8a5ba341fce1 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Calling method '.version_select at 0x7fa718fd35e0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:10:58.356188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-4ccf4ee7-19c4-4a01-9da5-8a5ba341fce1 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] HTTP exception thrown: Volume 145c8c91-a714-4c8b-b1e1-005ee2347b23 could not be found. Sep 22 13:10:58.357394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4ccf4ee7-19c4-4a01-9da5-8a5ba341fce1 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 404 to user: Volume 145c8c91-a714-4c8b-b1e1-005ee2347b23 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:58.358401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4ccf4ee7-19c4-4a01-9da5-8a5ba341fce1 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/145c8c91-a714-4c8b-b1e1-005ee2347b23" status: 404 len: 109 microversion: 2.1 time: 0.042827 Sep 22 13:10:58.359778 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 6/7] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:10:58 2021] DELETE /compute/v2.1/os-volumes/145c8c91-a714-4c8b-b1e1-005ee2347b23 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:10:58.398588 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6ce143cf-83f0-4fe2-9f6e-94f7b4202814 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Calling method '.version_select at 0x7fa718f911f0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:10:58.434553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] validate_networks() for [('5eacca51-cfa9-49d8-9462-091affedf979', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:10:58.463174 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-6ce143cf-83f0-4fe2-9f6e-94f7b4202814 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] HTTP exception thrown: Volume 40dc1bf8-6cb7-4f37-a010-8ad9c544015f could not be found. Sep 22 13:10:58.463815 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6ce143cf-83f0-4fe2-9f6e-94f7b4202814 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] Returning 404 to user: Volume 40dc1bf8-6cb7-4f37-a010-8ad9c544015f could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:10:58.464709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6ce143cf-83f0-4fe2-9f6e-94f7b4202814 tempest-VolumesNegativeTest-512667039 tempest-VolumesNegativeTest-512667039-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/40dc1bf8-6cb7-4f37-a010-8ad9c544015f" status: 404 len: 109 microversion: 2.1 time: 0.098946 Sep 22 13:10:58.465317 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 7/8] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:10:58 2021] GET /compute/v2.1/os-volumes/40dc1bf8-6cb7-4f37-a010-8ad9c544015f => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:10:59.718003 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:10:59.719148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:10:59.720564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:10:59.721649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:10:59.722609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:10:59.743865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:59.745610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:59.747819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:10:59.748485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:10:59.797807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Getting quotas for project f3e2fa50df244271b7c1994faa0b6e0b. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:10:59.809057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Getting quotas for user e1971d67580b47019bb4699566389fb2 and project f3e2fa50df244271b7c1994faa0b6e0b. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:10:59.829085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:10:59.832730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:00.035345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-835e4d3e-5d63-4ba5-9175-c9030df73ce1 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.457965 Sep 22 13:11:00.036898 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 2/9] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:10:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 13:11:00.048408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cf328d73-3f5e-476a-95d6-e1f87431848b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:00.049286 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cf328d73-3f5e-476a-95d6-e1f87431848b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:00.161799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-94db30b2-a565-4bb1-a86c-4dd5155364c3 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa7186bd310>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:00.225000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cf328d73-3f5e-476a-95d6-e1f87431848b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:00.241488 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cf328d73-3f5e-476a-95d6-e1f87431848b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1214 microversion: 2.1 time: 0.197763 Sep 22 13:11:00.243352 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 8/10] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:00 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:00.298534 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-94db30b2-a565-4bb1-a86c-4dd5155364c3 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/540bd198-76be-4226-90a5-df30271b40ba" status: 200 len: 351 microversion: 2.1 time: 0.147488 Sep 22 13:11:00.299388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 3/11] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:11:00 2021] GET /compute/v2.1/os-volumes/540bd198-76be-4226-90a5-df30271b40ba => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:01.259266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0353dec3-e5ea-461a-a193-b4cd2b29428b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:01.266819 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0353dec3-e5ea-461a-a193-b4cd2b29428b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:01.359372 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0353dec3-e5ea-461a-a193-b4cd2b29428b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:01.371049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0353dec3-e5ea-461a-a193-b4cd2b29428b tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1214 microversion: 2.1 time: 0.114992 Sep 22 13:11:01.381587 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 9/12] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:01 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:02.255656 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-db9292e0-98be-41ca-b1de-04b0fbd8a2df tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718f53670>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:02.351471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-db9292e0-98be-41ca-b1de-04b0fbd8a2df tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f4a9f598-052c-41d8-88d5-54a00ffa449f" status: 200 len: 351 microversion: 2.1 time: 0.100144 Sep 22 13:11:02.355114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 10/13] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:11:02 2021] GET /compute/v2.1/os-volumes/f4a9f598-052c-41d8-88d5-54a00ffa449f => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:02.388847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f93499ce-c294-4e7e-8b15-ea5141e0e51f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:02.389459 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f93499ce-c294-4e7e-8b15-ea5141e0e51f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:02.402527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-182587230", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "486be222-2dae-4806-b5f2-6aa278197135"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:02.525562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] validate_networks() for [('486be222-2dae-4806-b5f2-6aa278197135', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:02.528019 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f93499ce-c294-4e7e-8b15-ea5141e0e51f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:02.536098 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f93499ce-c294-4e7e-8b15-ea5141e0e51f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1214 microversion: 2.1 time: 0.150374 Sep 22 13:11:02.539516 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 11/14] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:02 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:03.558028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:03.563342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:03.580886 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:03.581359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:03.582170 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:03.583195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:04.026313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:04.050433 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5b73c1ef-8ff5-443b-b928-3304aee50b2a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1218 microversion: 2.1 time: 0.500153 Sep 22 13:11:04.060354 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 12/15] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:03 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1218 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:04.161977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:04.164712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:04.166178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:04.166819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:04.168121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:04.215123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:04.215123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:04.215123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:04.215123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:04.220748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:04.226390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for user 028372696b274b29b940bf5a602c4471 and project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:04.240624 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:04.243202 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:04.346842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-55bc3f28-5539-4f7d-acca-4e3ca50b6c9f tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718ed7670>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:04.431634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-659baf51-737a-4806-9367-fc81e303147b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514555 Sep 22 13:11:04.435078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 4/16] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:11:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:11:04.450219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4b250070-9be5-47ba-9f33-7d3a763943fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:04.452490 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4b250070-9be5-47ba-9f33-7d3a763943fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:04.503745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-55bc3f28-5539-4f7d-acca-4e3ca50b6c9f tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f080e911-f241-4a21-b2db-8275b1c9dee5" status: 200 len: 351 microversion: 2.1 time: 0.169739 Sep 22 13:11:04.505981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 13/17] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:11:04 2021] GET /compute/v2.1/os-volumes/f080e911-f241-4a21-b2db-8275b1c9dee5 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:04.517600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-22b7125f-1aa2-4ef7-b2c5-c963acc611f1 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718ee31f0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:04.661000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4b250070-9be5-47ba-9f33-7d3a763943fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:04.704970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4b250070-9be5-47ba-9f33-7d3a763943fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1217 microversion: 2.1 time: 0.262623 Sep 22 13:11:04.706011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 5/18] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:04 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:04.749129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-22b7125f-1aa2-4ef7-b2c5-c963acc611f1 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.234375 Sep 22 13:11:04.750028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 14/19] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Sep 22 13:11:04 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:04.771463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7e012d5b-64ff-4e39-befb-671f90c27b2c tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718646310>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.080475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7e012d5b-64ff-4e39-befb-671f90c27b2c tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.315284 Sep 22 13:11:05.089129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 6/20] 10.222.0.43 () {58 vars in 1149 bytes} [Wed Sep 22 13:11:04 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:05.093720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fe38a338-788c-4105-b181-dbbf523e4146 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718f3cb80>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.114395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.114936 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:05.155330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:05.158597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:05.159502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:05.211214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:05.576982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fe38a338-788c-4105-b181-dbbf523e4146 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.487146 Sep 22 13:11:05.577959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 15/21] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:05.591867 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-61620d95-825b-440d-9f5c-225fa0aad89b tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718ed75e0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.616714 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:05.631935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-43ee7d18-5ce9-480d-9b7a-855e826a2056 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1274 microversion: 2.1 time: 0.521368 Sep 22 13:11:05.632979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 7/22] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1274 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:05.724166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-99eed63e-8568-4660-855c-719c4dd4988b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.724841 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-99eed63e-8568-4660-855c-719c4dd4988b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:05.752337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-61620d95-825b-440d-9f5c-225fa0aad89b tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.166124 Sep 22 13:11:05.753650 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 16/23] 10.222.0.43 () {58 vars in 1167 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:05.766291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-da6e653f-ce03-478a-8280-187597dcf5b4 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718ecab80>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.927368 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-da6e653f-ce03-478a-8280-187597dcf5b4 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164892 Sep 22 13:11:05.928357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 17/24] 10.222.0.43 () {58 vars in 1170 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:05.940568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-82e18368-9407-4958-a201-768932987f16 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718fd3790>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:05.984378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-99eed63e-8568-4660-855c-719c4dd4988b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:05.998205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-99eed63e-8568-4660-855c-719c4dd4988b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1217 microversion: 2.1 time: 0.279844 Sep 22 13:11:06.002307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 8/25] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:06.169673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-82e18368-9407-4958-a201-768932987f16 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.233199 Sep 22 13:11:06.170755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 18/26] 10.222.0.43 () {58 vars in 1155 bytes} [Wed Sep 22 13:11:05 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:06.184033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52f77eb5-4d57-408d-a482-a3799fb8c0f4 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa7185d3940>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:06.380879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52f77eb5-4d57-408d-a482-a3799fb8c0f4 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192740 Sep 22 13:11:06.380879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 9/27] 10.222.0.43 () {58 vars in 1188 bytes} [Wed Sep 22 13:11:06 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:06.385527 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-02024e31-bcf0-4525-a372-c0512cf33df3 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] Calling method '.version_select at 0x7fa718ed7af0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:06.653143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:06.653947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:06.688403 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:06.688871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:06.689664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:06.690517 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:06.729532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-02024e31-bcf0-4525-a372-c0512cf33df3 tempest-VolumesTestJSON-1489964391 tempest-VolumesTestJSON-1489964391-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.347547 Sep 22 13:11:06.734819 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 19/28] 10.222.0.43 () {58 vars in 1155 bytes} [Wed Sep 22 13:11:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:06.848962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:06.857569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bdea5445-a3d6-4dca-af6a-037657a927ce tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1274 microversion: 2.1 time: 0.211386 Sep 22 13:11:06.861031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 10/29] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:06 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:07.022320 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-98c2d2df-a72a-4f31-8a04-f8108eeeccd1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:07.023753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-98c2d2df-a72a-4f31-8a04-f8108eeeccd1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:07.267509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-98c2d2df-a72a-4f31-8a04-f8108eeeccd1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:07.277892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-98c2d2df-a72a-4f31-8a04-f8108eeeccd1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1217 microversion: 2.1 time: 0.263327 Sep 22 13:11:07.291306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 20/30] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:07 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:07.877456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:07.878125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:07.894569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:07.900192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:07.907019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:07.907019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:08.327770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:08.327770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:08.327770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:08.327770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:08.328813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:08.328813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:08.793350 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:08.803490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:08.806513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-32752ac2-cc57-4d59-bca4-3cbc73868510 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1274 microversion: 2.1 time: 0.698028 Sep 22 13:11:08.809386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0023cff8-ba5d-490d-9656-02bb0f0020f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1213 microversion: 2.1 time: 0.301041 Sep 22 13:11:08.810790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 11/31] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:07 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1274 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:08.811636 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 21/32] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:08 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:09.379956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: .version_select at 0x7fa718646550>, body: {"keypair": {"name": "tempest-keypair-1932837670"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:09.457677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:09.466039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:09.625970 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:09.627342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:09.643309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:09.646934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:09.647692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:09.648453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:10.064375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:10.087851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fbe1aa44-04d9-4ebf-9187-d2e004944f89 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1272 microversion: 2.1 time: 0.473717 Sep 22 13:11:10.092513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 22/33] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:09 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1272 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:10.114181 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:10.115340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:10.136117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:10.140018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:10.143708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:10.144261 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:10.330078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:10.348193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8e64fe10-7052-4dc2-a88b-a7cddc24b6fd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1275 microversion: 2.1 time: 0.253912 Sep 22 13:11:10.348809 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 23/34] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:10 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:10.372728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:10.387894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:10.436199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9380a0cc-fd98-4f5e-928c-523ee1117b78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.282201 Sep 22 13:11:10.436917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 12/35] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Sep 22 13:11:09 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1287 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 22 13:11:11.117914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:11.118469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:11.135408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:11.136409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:11.151910 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:11.156001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:11.372305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:11.380144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:11.388404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:11.390146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:11.391330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:11.392011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:11.463345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:11.479316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1a0ce677-b958-49ff-9c40-342cfaae06dc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1272 microversion: 2.1 time: 0.375350 Sep 22 13:11:11.480633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 24/36] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:11 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:11.612296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:11.634952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-261314db-7730-4b6f-b2cd-cd743d785e19 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1275 microversion: 2.1 time: 0.268646 Sep 22 13:11:11.644935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 13/37] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:11 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:12.507108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:12.507108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:12.517439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:12.517902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:12.518680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:12.519105 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:12.661136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:12.662493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:12.670042 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:12.671763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:12.673140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:12.673790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:12.811413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:12.826686 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a483b98a-6c7a-4794-9955-28214b767e5f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1275 microversion: 2.1 time: 0.172441 Sep 22 13:11:12.827817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 14/38] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:12 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:13.139011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:13.155560 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5a38650b-a8d8-427c-bcd8-c29e29334dbc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.662919 Sep 22 13:11:13.174881 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 25/39] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:12 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:13.244232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: .version_select at 0x7fa7185bfca0>, body: {"keypair": {"name": "tempest-keypair-674324468"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:13.309418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:13.321337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:13.527794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-871257250", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ea9935-8102-4648-ae6c-92fac791d7fa"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:14.037676 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] validate_networks() for [('c6ea9935-8102-4648-ae6c-92fac791d7fa', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:14.098285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:14.110195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:14.153550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-50af3a44-82d0-46a9-a95f-edea92bab0fe tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.181648 Sep 22 13:11:14.166141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 15/40] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Sep 22 13:11:12 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:14.191985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:14.194969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:14.211178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:14.231035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:14.232323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:14.234958 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:15.101712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:15.101712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d3df512b-0956-46a1-bdd6-0a55b08d12f4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.911134 Sep 22 13:11:15.101712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 16/41] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:14 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:15.101712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:15.102498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:15.102498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:15.102498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:15.102498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:15.102737 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:15.838023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:15.838593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:15.839015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:15.839468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:15.839859 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:15.918595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:15.919303 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:15.924403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:15.925326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:16.024693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Getting quotas for project d04a4440bd974592a2c14375e7f7fa18. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:16.036667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Getting quotas for user e8ecad35324343bf8403f1e8f8088f39 and project d04a4440bd974592a2c14375e7f7fa18. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:16.054409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:16.066624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:16.190101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:16.206369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-811912b8-5b43-4489-a1ee-1692982f1b61 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 1.123742 Sep 22 13:11:16.218689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 17/42] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:15 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:16.225029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:16.226072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:16.233870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:16.234706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:16.235934 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:16.236725 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:16.539382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b861ea1e-8475-42e3-b06a-c91dd79b69d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.215340 Sep 22 13:11:16.539382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 26/43] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:11:13 2021] POST /compute/v2.1/servers => generated 383 bytes in 3219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:11:16.539382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b8680ca5-123d-4fdb-8140-8e036c486d0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:16.539382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b8680ca5-123d-4fdb-8140-8e036c486d0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:16.565757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b8680ca5-123d-4fdb-8140-8e036c486d0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:16.589783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b8680ca5-123d-4fdb-8140-8e036c486d0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1221 microversion: 2.1 time: 0.196462 Sep 22 13:11:16.595008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 27/44] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:16 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1221 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:16.812197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-377996556", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ea9935-8102-4648-ae6c-92fac791d7fa"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:17.099529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] validate_networks() for [('c6ea9935-8102-4648-ae6c-92fac791d7fa', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:18.078270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:18.078718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:18.079222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:18.079763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:18.081212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:18.111718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:18.112652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:18.113041 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:18.117118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:18.172571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Getting quotas for project d04a4440bd974592a2c14375e7f7fa18. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:18.172571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Getting quotas for user e8ecad35324343bf8403f1e8f8088f39 and project d04a4440bd974592a2c14375e7f7fa18. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:18.220904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:18.235032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:18.318473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:18.342970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-31313b7b-cbc2-4847-a3ab-a1765211f316 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 2.119009 Sep 22 13:11:18.344103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 18/45] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:16 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:18.373229 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:18.374475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:18.386557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:18.387523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:18.388945 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:18.389810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:18.473920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dba47d0c-a6a8-44aa-aebe-21c7dbc339ce tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.671780 Sep 22 13:11:18.478833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 28/46] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:11:16 2021] POST /compute/v2.1/servers => generated 383 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:11:18.498610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-907fdf0c-0f7a-48e0-9e69-e51f26a3c76e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:18.502305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-907fdf0c-0f7a-48e0-9e69-e51f26a3c76e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:18.749962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-907fdf0c-0f7a-48e0-9e69-e51f26a3c76e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:18.757104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-907fdf0c-0f7a-48e0-9e69-e51f26a3c76e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1221 microversion: 2.1 time: 0.270069 Sep 22 13:11:18.764618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 29/47] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:18 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:19.339347 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-861b8bb7-2b24-46c4-92fc-2f4aca9fc8fb req-c33e4ba7-68da-4f03-a036-6278a542908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bb6655-1b93-4b10-a1fe-b73fd3adaff8", "tag": "a2bbb5b2-cff5-4e17-b8fc-9bf130271e67"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:19.341432 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:19.341432 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:19.401651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-861b8bb7-2b24-46c4-92fc-2f4aca9fc8fb req-c33e4ba7-68da-4f03-a036-6278a542908d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:19.402086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-861b8bb7-2b24-46c4-92fc-2f4aca9fc8fb req-c33e4ba7-68da-4f03-a036-6278a542908d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:19.489856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-861b8bb7-2b24-46c4-92fc-2f4aca9fc8fb req-c33e4ba7-68da-4f03-a036-6278a542908d service nova] Creating event network-changed:a2bbb5b2-cff5-4e17-b8fc-9bf130271e67 for instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 on hv-cinder-81000 Sep 22 13:11:19.489856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-861b8bb7-2b24-46c4-92fc-2f4aca9fc8fb req-c33e4ba7-68da-4f03-a036-6278a542908d service nova] Acquired lock "compute-rpcapi-router" {{(pid=109167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 22 13:11:19.489856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:19.489856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:19.489856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:19.490386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:19.558776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.compute.rpcapi [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 22 13:11:19.558776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] Releasing lock "compute-rpcapi-router" {{(pid=109167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 22 13:11:19.660337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fbc9bc68-0739-4e88-abad-ecdbbf15b30a None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.886124 Sep 22 13:11:19.662501 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 30/48] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:19.679011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:19.696981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:19.701751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:19.720123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-840427ff-fa74-4915-abb5-34d082630bfc tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 1.347796 Sep 22 13:11:19.720123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 19/49] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:18 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:19.725071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:19.725522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:19.741460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:19.741936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:19.823061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5962e39a-decb-4296-9675-78bb657e1df3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:19.823061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5962e39a-decb-4296-9675-78bb657e1df3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:20.109537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5962e39a-decb-4296-9675-78bb657e1df3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:20.118464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5962e39a-decb-4296-9675-78bb657e1df3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1221 microversion: 2.1 time: 0.337809 Sep 22 13:11:20.122026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 20/50] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:19 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1221 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:20.131313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:20.141803 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fc25cb33-5090-458f-87cb-f73ef4fe5058 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.472008 Sep 22 13:11:20.142434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 31/51] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:19 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:20.732159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:20.732840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:20.763930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:20.764470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:20.765339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:20.768446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:21.138028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:21.138621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:21.153664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:21.156633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:21.157807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:21.164656 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:21.306947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:21.321764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bd97d6b3-ae2b-4780-bdd6-30afd6a5f4ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1225 microversion: 2.1 time: 0.187044 Sep 22 13:11:21.334484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 32/52] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:21 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:21.339244 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:21.340313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:21.375900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:21.375900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:21.376684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:21.377188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:21.983250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:21.998929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-478452a1-c211-400f-8abe-db39ac202aef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.663679 Sep 22 13:11:22.009420 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 33/53] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:21 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:22.015062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-7c7ead95-0943-4595-b4cf-f92110e7901b req-8f2247c1-87a9-4c2d-846b-246eeb7656fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7", "tag": "0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:22.016994 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:22.016994 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:22.037121 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-7c7ead95-0943-4595-b4cf-f92110e7901b req-8f2247c1-87a9-4c2d-846b-246eeb7656fb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:22.038005 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-7c7ead95-0943-4595-b4cf-f92110e7901b req-8f2247c1-87a9-4c2d-846b-246eeb7656fb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:22.066237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-7c7ead95-0943-4595-b4cf-f92110e7901b req-8f2247c1-87a9-4c2d-846b-246eeb7656fb service nova] Creating event network-changed:0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4 for instance 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 on hv-cinder-81000 Sep 22 13:11:22.071886 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-7c7ead95-0943-4595-b4cf-f92110e7901b req-8f2247c1-87a9-4c2d-846b-246eeb7656fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060752 Sep 22 13:11:22.073046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 34/54] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:22.221805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:22.237943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-206992b8-a2a4-4617-a424-9d4688c26b3a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 1.514555 Sep 22 13:11:22.243743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 21/55] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:20 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:22.348240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:22.349782 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:22.372384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:22.372957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:22.373767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:22.374207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:23.020031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:23.020654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:23.053163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:23.053163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:23.053163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:23.053163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:23.209868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:23.232155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9923a181-bbdc-4488-ba6e-bbc857f122fd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1273 microversion: 2.1 time: 0.883586 Sep 22 13:11:23.232155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 35/56] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:22 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1273 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:23.262861 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:23.264147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:23.277189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:23.277653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:23.278472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:23.278914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:23.736747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:23.747133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e7d23afe-42e5-49bf-abf3-0a21e3fea745 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.490101 Sep 22 13:11:23.772295 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 36/57] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:23 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:24.100191 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:24.122902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2050b0c8-0b4c-4e36-8432-038542ccc373 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 1.108875 Sep 22 13:11:24.124649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 22/58] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:23 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:24.259296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:24.259296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:24.259296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:24.259296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:24.259896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:24.259896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:24.359296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1451596495", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc619f7c-a032-4a42-ba73-abb931db8402"}], "security_groups": [{"name": "tempest-securitygroup--163295923"}], "key_name": "tempest-keypair-1932837670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:24.658371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:24.672896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b2132534-03ef-419d-93f0-681da6c5977c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1281 microversion: 2.1 time: 0.431453 Sep 22 13:11:24.675646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 37/59] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:24 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1281 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:24.680711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] validate_networks() for [('cc619f7c-a032-4a42-ba73-abb931db8402', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:24.783566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:24.786401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:24.799068 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:24.800442 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:24.802312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:24.803906 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.431606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:25.444124 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2f2a7c24-e4cb-4f8a-afab-9170f690e778 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.665127 Sep 22 13:11:25.458663 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 38/60] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:24 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:25.465980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:25.466864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:25.476953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.477708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.479605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.481105 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.745695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:25.753436 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8353349b-4886-44f0-89fe-fa81b746f097 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.292243 Sep 22 13:11:25.754429 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 39/61] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:25 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:25.768894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:25.770904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:25.776234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.776973 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.777942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.778385 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.890583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:25.897730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:25.898545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:25.899223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:25.900113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:25.914608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.915200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.916208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:25.917600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:25.939978 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:25.947372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:25.966183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:25.969644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:25.982478 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:25.994598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4a121a09-af47-4072-935d-1d57a3e44475 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1279 microversion: 2.1 time: 0.230012 Sep 22 13:11:25.995609 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 40/62] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:25 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:26.474853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:26.475491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:26.481237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:26.481710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:26.482508 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:26.482962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:26.497000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42a2e4a8-4f7b-4d43-bf4b-f69082e4ad0b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.150496 Sep 22 13:11:26.502365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 23/63] 10.222.0.43 () {62 vars in 1188 bytes} [Wed Sep 22 13:11:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 22 13:11:26.510960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:26.511698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:26.572374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:26.580180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:26.582839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:26.584545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee9feb53-5a25-45bd-8699-3595eeb2c4cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1282 microversion: 2.20 time: 0.077304 Sep 22 13:11:26.596410 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 24/64] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:26 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:26.770472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:26.771190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:26.777429 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:26.788178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:26.789275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:26.789723 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:26.921438 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:26.929144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3b6f814c-931e-4993-9714-6fabc0b42970 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.162875 Sep 22 13:11:26.929692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 25/65] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:26 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:26.940830 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:26.948159 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e1b55abd-83ee-48af-87d6-44b5f5381e04 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.477827 Sep 22 13:11:26.948735 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 41/66] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:26 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:27.013108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:27.014038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:27.021064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:27.021875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:27.022627 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:27.023072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:27.255750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:27.265035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7b753bef-632d-4431-9b4f-bacc770d05a2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.255846 Sep 22 13:11:27.275305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 26/67] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:27 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:27.603215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:27.606749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:27.655942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:27.663369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:27.668503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:27.668503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c834e9e3-9710-4ad7-8f5b-03210c7e0469 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1282 microversion: 2.20 time: 0.068112 Sep 22 13:11:27.668503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 42/68] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:27 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:27.951011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:27.952370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:27.971219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:27.977649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:27.980977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:27.981434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:27.982600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:27.983115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:27.998914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.001627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.012493 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.019348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.167344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.178183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-21c514de-a5d3-48ef-9c12-e6f1e4f2dd3d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.234720 Sep 22 13:11:28.180341 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 27/69] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:27 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:28.185853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1148963119", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ff256e-94df-44a6-b96c-3d0c6896f093"}], "security_groups": [{"name": "tempest-securitygroup--1902137601"}], "key_name": "tempest-keypair-674324468", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:28.346985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.362895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5c19ab63-28b9-47eb-859d-b5572620f80e tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.399037 Sep 22 13:11:28.370917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 43/70] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:27 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:28.373802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:28.374956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:28.386181 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.387785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.387915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] validate_networks() for [('f7ff256e-94df-44a6-b96c-3d0c6896f093', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:28.388246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.388999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.665001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.672889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3d5567d9-3a35-4646-b2a1-ef5b866c6ccb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.306634 Sep 22 13:11:28.673469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 44/71] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:28 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:28.684924 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:28.685870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:28.693419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.694155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.694942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:28.695624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:28.853382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.856720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.858468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:28.860049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f4f3fb7f-4a88-4b40-83b5-1cd120084907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1286 microversion: 2.20 time: 0.178784 Sep 22 13:11:28.871189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 45/72] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:28 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:29.102976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:29.103749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:29.104849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:29.105904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:29.106751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:29.139326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.140171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.141302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.141938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.155851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-ebbbd464-9361-41c7-8b67-eedc25035d7d req-3a06330a-d565-4aee-8030-ac10a184350a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51372312-678a-4ec5-8407-7ef186a53479", "tag": "77b84daf-d8c2-48ad-9cf3-ea50800c0b2d"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:29.158140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:29.158140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:29.168908 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ebbbd464-9361-41c7-8b67-eedc25035d7d req-3a06330a-d565-4aee-8030-ac10a184350a service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.169924 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ebbbd464-9361-41c7-8b67-eedc25035d7d req-3a06330a-d565-4aee-8030-ac10a184350a service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.186580 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:29.195540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:29.211350 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-ebbbd464-9361-41c7-8b67-eedc25035d7d req-3a06330a-d565-4aee-8030-ac10a184350a service nova] Creating event network-changed:77b84daf-d8c2-48ad-9cf3-ea50800c0b2d for instance 51372312-678a-4ec5-8407-7ef186a53479 on hv-cinder-81000 Sep 22 13:11:29.223623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-ebbbd464-9361-41c7-8b67-eedc25035d7d req-3a06330a-d565-4aee-8030-ac10a184350a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072804 Sep 22 13:11:29.223854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:29.225210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 46/73] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:29.234565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:29.236196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:29.242840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:29.245142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.246432 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.247406 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.248153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.483417 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:29.497390 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ea91a44e-1b5c-4a44-b33a-f4b6a6a43e77 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.270522 Sep 22 13:11:29.499745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 47/74] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:29 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:29.525575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1880f7fa-d53f-4e61-b034-d069539619b3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.343431 Sep 22 13:11:29.527247 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 28/75] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:11:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:11:29.536314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:29.537760 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:29.553709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.554499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:29.555876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:29.556898 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.125837 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-e5161ac8-df54-4237-80fe-31e7cd73f559 req-9c67e7d5-130e-40fb-a834-3dfda48d8158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dd1478-ba12-4a46-8c78-62519c2c512b", "tag": "e985e239-a74d-451d-b44e-08c49c83ef5e"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:30.136434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:30.136434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:30.166252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-e5161ac8-df54-4237-80fe-31e7cd73f559 req-9c67e7d5-130e-40fb-a834-3dfda48d8158 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.170393 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-e5161ac8-df54-4237-80fe-31e7cd73f559 req-9c67e7d5-130e-40fb-a834-3dfda48d8158 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.189895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:30.208859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-91f5ac03-fea9-4769-bdfa-478b0ca55b7a tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.679820 Sep 22 13:11:30.211023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-e5161ac8-df54-4237-80fe-31e7cd73f559 req-9c67e7d5-130e-40fb-a834-3dfda48d8158 service nova] Creating event network-changed:e985e239-a74d-451d-b44e-08c49c83ef5e for instance 62dd1478-ba12-4a46-8c78-62519c2c512b on hv-cinder-81000 Sep 22 13:11:30.222267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 29/76] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:29 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:30.223715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-e5161ac8-df54-4237-80fe-31e7cd73f559 req-9c67e7d5-130e-40fb-a834-3dfda48d8158 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.722447 Sep 22 13:11:30.229726 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 48/77] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:30.233858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2cbce6a9-4e4b-44b7-b388-61a088475de6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:30.237268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:30.238083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2cbce6a9-4e4b-44b7-b388-61a088475de6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:30.242142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:30.257710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.258491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.259589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.263467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.413995 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2cbce6a9-4e4b-44b7-b388-61a088475de6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:30.441944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2cbce6a9-4e4b-44b7-b388-61a088475de6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1237 microversion: 2.1 time: 0.213926 Sep 22 13:11:30.442928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 30/78] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:30 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:30.468840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:30.469810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:30.505389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.505389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.505389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.505389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.726930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:30.739142 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:30.743483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:30.764570 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-71d5fc07-b844-430c-9f51-1ab57401c16d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1352 microversion: 2.20 time: 0.309765 Sep 22 13:11:30.765325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 31/79] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:30 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1352 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:30.776756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:30.794049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:30.817856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.818288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:30.826368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:30.828126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:31.052707 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.065917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-12ad7fc5-1266-492f-9f7f-c8fca02c6f79 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.833614 Sep 22 13:11:31.068918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 49/80] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:30 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:31.188604 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.202063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1facad25-aeaf-4c04-8070-fe08b778d24a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.434361 Sep 22 13:11:31.203372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 32/81] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:30 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:31.226837 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:31.227457 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:31.237816 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:31.238422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:31.277696 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:31.277696 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:31.469045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d97d47a-d3ce-41d1-9958-9e7391e98b36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:31.469984 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7d97d47a-d3ce-41d1-9958-9e7391e98b36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:31.553162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7d97d47a-d3ce-41d1-9958-9e7391e98b36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.560646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7d97d47a-d3ce-41d1-9958-9e7391e98b36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1237 microversion: 2.1 time: 0.095258 Sep 22 13:11:31.570844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 33/82] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:31 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:31.579612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.592600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5a24f9ad-30d6-41ee-8d73-08404ea382b2 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.369333 Sep 22 13:11:31.603384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 50/83] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:31 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:31.798467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:31.799073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:31.805697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:31.806144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:31.809586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:31.809586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:31.907317 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.922830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.924472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:31.926136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bdaf99a3-cab5-4474-9cb8-e534c4548736 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1340 microversion: 2.20 time: 0.131152 Sep 22 13:11:31.926508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 34/84] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:31 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:32.083188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:32.083892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:32.089732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.090167 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.091115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.091562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.221680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:32.222320 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:32.232454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.237924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.238585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.239030 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.263980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:32.273738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1e03f393-388d-4768-b7a8-9f91d51f86a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.195476 Sep 22 13:11:32.277653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 51/85] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:32 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:32.477925 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:32.488881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1986588f-8253-40f9-8281-f7a6aaf5dc9f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.271130 Sep 22 13:11:32.491474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 35/86] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:32 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:32.579967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:32.582149 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:32.591359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.592638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.593801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.594434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.610086 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:32.610907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:32.617607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.618885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.619952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.620554 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.712792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:32.720557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-87885cac-bbf0-46ab-afd1-877bbe89e0f1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1289 microversion: 2.1 time: 0.146031 Sep 22 13:11:32.721187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 52/87] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:32 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:32.774036 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:32.781213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9f664858-ee53-42ee-b4d7-5461bb309d21 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.174931 Sep 22 13:11:32.781776 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 36/88] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:32 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:32.951652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:32.952373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:32.962941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.965343 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:32.966209 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:32.968118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.191139 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:33.199256 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:33.200947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:33.202087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cd4ab78d-ab92-41f3-b0a8-1f3710a309de tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.258159 Sep 22 13:11:33.215812 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 53/89] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:32 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:33.293848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:33.294878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:33.301976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.309895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.309895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.309895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.510246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:33.510752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:33.521874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.522757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.523993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.524656 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.642480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:33.652886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7dc4511-f09d-4af2-b2b1-10e06a403f98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.361663 Sep 22 13:11:33.667885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 37/90] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:33 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:33.673963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-3d63f5ea-4bda-4875-972d-64d33262d842 req-17e238e0-14a8-4286-9036-55a6164194d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:33.682841 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:33.682841 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:11:33.694638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3d63f5ea-4bda-4875-972d-64d33262d842 req-17e238e0-14a8-4286-9036-55a6164194d7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.695319 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3d63f5ea-4bda-4875-972d-64d33262d842 req-17e238e0-14a8-4286-9036-55a6164194d7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.719009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-3d63f5ea-4bda-4875-972d-64d33262d842 req-17e238e0-14a8-4286-9036-55a6164194d7 service nova] Creating event network-changed:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:11:33.719895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-3d63f5ea-4bda-4875-972d-64d33262d842 req-17e238e0-14a8-4286-9036-55a6164194d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 22 13:11:33.721916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.725706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.725706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.725706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.757560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.compute.rpcapi [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 22 13:11:33.765119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] Releasing lock "compute-rpcapi-router" {{(pid=109168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 22 13:11:33.812228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b3fd615c-63c4-4992-af20-895d684bfb67 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141857 Sep 22 13:11:33.814478 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 38/91] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:33.822871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:33.828268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:33.938099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.938099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.938099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.938099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.940874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:33.940874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-289106ce-5db4-4fe4-b3b0-d97865c7d3f5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1307 microversion: 2.1 time: 0.112482 Sep 22 13:11:33.940874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 39/92] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:33 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:33.946274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:33.946916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:33.953506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.954149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:33.955028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:33.956223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.122967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:34.137178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-70cdc184-86e4-41e4-9727-7647d950a5f6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.631074 Sep 22 13:11:34.143544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:34.145132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 54/93] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:33 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:34.166177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-66371ea4-47d7-458f-817f-47e8c3e6ad46 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.221965 Sep 22 13:11:34.177382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 40/94] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:33 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:34.220894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:34.222023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:34.230069 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-da664e3c-77c4-4b6d-813a-7d1854226655 req-7cc85fd9-e650-4788-b5db-7b4e62059b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb6655-1b93-4b10-a1fe-b73fd3adaff8", "name": "network-vif-plugged", "status": "completed", "tag": "a2bbb5b2-cff5-4e17-b8fc-9bf130271e67"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:34.230963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.231688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.231810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:34.231810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:34.232954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.233595 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.242237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-da664e3c-77c4-4b6d-813a-7d1854226655 req-7cc85fd9-e650-4788-b5db-7b4e62059b24 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.243171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-da664e3c-77c4-4b6d-813a-7d1854226655 req-7cc85fd9-e650-4788-b5db-7b4e62059b24 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.262953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-da664e3c-77c4-4b6d-813a-7d1854226655 req-7cc85fd9-e650-4788-b5db-7b4e62059b24 service nova] Creating event network-vif-plugged:a2bbb5b2-cff5-4e17-b8fc-9bf130271e67 for instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 on hv-cinder-81000 Sep 22 13:11:34.269382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-da664e3c-77c4-4b6d-813a-7d1854226655 req-7cc85fd9-e650-4788-b5db-7b4e62059b24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121947 Sep 22 13:11:34.270301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 55/95] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:34.410937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:34.429601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:34.442638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:34.444513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5abe350b-71bf-441c-850c-a06da50a7e65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.227990 Sep 22 13:11:34.445549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 41/96] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:34 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:34.675931 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:34.680322 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:34.687241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.688203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.689385 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.690646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.948436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:34.949613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:34.957971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.958705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:34.959998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:34.961250 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.070364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.085336 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34416ab7-e254-4f6e-90a3-deb80762dd10 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1295 microversion: 2.1 time: 0.138833 Sep 22 13:11:35.085336 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 42/97] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:34 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:35.155110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:35.156134 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:35.166909 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.168665 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.171468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.175760 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.177596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.188951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-478dc2df-6f32-4aa1-9e1e-171bb932ac60 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.518728 Sep 22 13:11:35.191367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 56/98] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:34 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:35.197831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:35.199212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:35.208766 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.209514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.210533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.211133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.409048 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.417571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2c3bc084-c1cf-461e-a076-e1656096b2ee tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.267242 Sep 22 13:11:35.423070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 43/99] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:35 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:35.461855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.465214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:35.467365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:35.476168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-070e555e-a19b-48c5-b3f7-482ecb2f4d35 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.283423 Sep 22 13:11:35.476930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.478788 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.487138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:35.487138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:35.487935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 57/100] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:35 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:35.642751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.657778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.659955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:35.661124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34e064ff-8a98-4eb6-b06c-d193272997ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.201697 Sep 22 13:11:35.661694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 44/101] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:35 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:11:36.100653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:36.102370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:36.112610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.113323 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.114264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.115066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.207995 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:36.208703 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:36.214863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.215505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.216377 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.216904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.251011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.262340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2667989b-bc79-4a02-9ba7-00d9a79f8e62 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.166336 Sep 22 13:11:36.263047 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 58/102] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:36 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:36.308458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7", "name": "network-vif-plugged", "status": "completed", "tag": "0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4"}, {"server_uuid": "62dd1478-ba12-4a46-8c78-62519c2c512b", "name": "network-vif-plugged", "status": "completed", "tag": "e985e239-a74d-451d-b44e-08c49c83ef5e"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:36.310367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:36.310367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:36.319450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.326862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.333772 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] Creating event network-vif-plugged:0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4 for instance 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 on hv-cinder-81000 Sep 22 13:11:36.334268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] Creating event network-vif-plugged:e985e239-a74d-451d-b44e-08c49c83ef5e for instance 62dd1478-ba12-4a46-8c78-62519c2c512b on hv-cinder-81000 Sep 22 13:11:36.340879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-4e9b7625-7d05-4ab8-a1c2-0b555b460fe6 req-f7e0a267-b53c-43d5-afa3-3e66ef200eef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036047 Sep 22 13:11:36.341482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 59/103] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:36.398664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.426559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-66bae86a-4787-4893-80f3-af0be66bb8f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.222682 Sep 22 13:11:36.432700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 45/104] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:36 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:36.447854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:36.448965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:36.456447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.457196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.458287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.458982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.495787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:36.497330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:36.503821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.504568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.514695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.514695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.683831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.692987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5babd4a0-9fb0-4f25-8ae5-1773b763c514 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.202820 Sep 22 13:11:36.694011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 46/105] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:36 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:36.705420 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:36.706434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:36.716316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.716316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.716316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:36.716316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:36.748078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.755804 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e65bce78-52d9-4768-bdf6-258ec928f131 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.325064 Sep 22 13:11:36.756552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 60/106] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:36 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:36.882953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.893240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.902029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:36.903645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0ee6656a-cda1-461a-84a6-c55c8f42e693 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.202262 Sep 22 13:11:36.915975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 47/107] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:36 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:37.278763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:37.280364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:37.293907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.295558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.296704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.297359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.449919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:37.451368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:37.459591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.460378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.461472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.462135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.557348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:37.565179 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-72bf8a95-78ac-42a8-b202-c4536137973d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.290760 Sep 22 13:11:37.567891 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 61/108] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:37 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:37.638204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:37.647349 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-78143eb5-6895-4b69-8c53-932797f4964e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.200980 Sep 22 13:11:37.648596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 48/109] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:37 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:37.709679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:37.710360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:37.716466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.716901 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.717657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.718145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.773761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:37.774368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:37.780893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.781632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.782473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:37.782844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:37.962200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:37.978022 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ec6a91f9-5c69-4eb5-9d4d-6708e2249ae9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1317 microversion: 2.1 time: 0.208076 Sep 22 13:11:37.978725 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 49/110] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:37 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:37.986689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:37.988279 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:38.010912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.023045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.025737 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.031356 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.074961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.088343 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-99eece96-3b43-435e-a6a8-219cf5ec5128 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1314 microversion: 2.1 time: 0.383051 Sep 22 13:11:38.089868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 62/111] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:37 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:38.102730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-e866b953-9b2b-4780-84d6-5c4e25d98f98 req-88526b70-7b4e-4b13-b59c-ecfce90d7ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34469eaa-a287-41e5-a5cd-ad889e389ada", "tag": "f3ee028d-6a0d-4aa7-823b-d96fde18de61"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:38.109326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:38.109326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:38.137460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-e866b953-9b2b-4780-84d6-5c4e25d98f98 req-88526b70-7b4e-4b13-b59c-ecfce90d7ef7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.138039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-e866b953-9b2b-4780-84d6-5c4e25d98f98 req-88526b70-7b4e-4b13-b59c-ecfce90d7ef7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.153637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-e866b953-9b2b-4780-84d6-5c4e25d98f98 req-88526b70-7b4e-4b13-b59c-ecfce90d7ef7 service nova] Creating event network-changed:f3ee028d-6a0d-4aa7-823b-d96fde18de61 for instance 34469eaa-a287-41e5-a5cd-ad889e389ada on hv-cinder-81000 Sep 22 13:11:38.162462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-e866b953-9b2b-4780-84d6-5c4e25d98f98 req-88526b70-7b4e-4b13-b59c-ecfce90d7ef7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070765 Sep 22 13:11:38.169062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 63/112] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:38.229293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.238401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.239944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.242459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3a884a1f-e8ab-451d-8088-12071dc7df07 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.261399 Sep 22 13:11:38.243463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 50/113] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:37 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:38.362927 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-5920c055-b36a-431f-8eec-6bacc7f1fc74 req-bc5f2923-62fb-4894-9c0b-34bc802d6a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51372312-678a-4ec5-8407-7ef186a53479", "name": "network-vif-plugged", "status": "completed", "tag": "77b84daf-d8c2-48ad-9cf3-ea50800c0b2d"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:38.364653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:38.364653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:38.371958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5920c055-b36a-431f-8eec-6bacc7f1fc74 req-bc5f2923-62fb-4894-9c0b-34bc802d6a6b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.372401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5920c055-b36a-431f-8eec-6bacc7f1fc74 req-bc5f2923-62fb-4894-9c0b-34bc802d6a6b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.384533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-5920c055-b36a-431f-8eec-6bacc7f1fc74 req-bc5f2923-62fb-4894-9c0b-34bc802d6a6b service nova] Creating event network-vif-plugged:77b84daf-d8c2-48ad-9cf3-ea50800c0b2d for instance 51372312-678a-4ec5-8407-7ef186a53479 on hv-cinder-81000 Sep 22 13:11:38.389771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-5920c055-b36a-431f-8eec-6bacc7f1fc74 req-bc5f2923-62fb-4894-9c0b-34bc802d6a6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Sep 22 13:11:38.390906 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 64/114] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:38.583208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:38.584674 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:38.591038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.591812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.592887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.593890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.665411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:38.666375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:38.673570 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.674353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.675539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:38.676165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:38.807044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.818943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7556f997-cb90-46fc-8f99-6365ecda582b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.237520 Sep 22 13:11:38.829470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 51/115] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:38 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:38.952156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:38.960975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-75990af1-57d8-4f98-9181-f60232b4e450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.299899 Sep 22 13:11:38.962838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 65/116] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:38 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:39.003025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:39.003674 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:39.011286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.012026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.013010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.013594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.105984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:39.106595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:39.114650 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.115095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.115900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.116331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.208602 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:39.219652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cb8aabbf-fc51-49b2-be7b-b6440d8a10e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1508 microversion: 2.1 time: 0.226843 Sep 22 13:11:39.235038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 52/117] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:38 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:39.261969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:39.262403 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:39.274146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.274593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.279165 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.279970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.432346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:39.440664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dd7a3bcc-c88d-40f4-a981-3c660ae3a90f tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1500 microversion: 2.1 time: 0.338294 Sep 22 13:11:39.441835 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 66/118] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:39 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1500 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:39.475778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:39.504609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:39.506382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:39.509444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f84a667e-1683-48c9-979a-71e61a337839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.252356 Sep 22 13:11:39.524254 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 53/119] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:39 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:11:39.839883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:39.839883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:39.853730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.855284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.857725 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.858166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.977965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:39.979302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:39.988957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.989404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:39.992477 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:39.993442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:40.056486 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:40.072099 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1c136717-6ff3-4e0f-b98a-c1f2f3c4ba21 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.239088 Sep 22 13:11:40.073066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 67/120] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:39 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:40.159620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:40.170607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-557d250a-f31b-443b-ba73-de4ac63b3869 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1321 microversion: 2.1 time: 0.196058 Sep 22 13:11:40.175461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 54/121] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:39 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:40.540389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:40.542222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:40.552312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:40.552758 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:40.553598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:40.554026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:40.735700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:40.744433 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:40.746454 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:40.747698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2cdf9df0-cd00-46d2-a04f-c48e30ffed38 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.215587 Sep 22 13:11:40.748371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 68/122] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:40 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:41.092734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:41.093484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:41.106103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.106541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.107500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.108062 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.191724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:41.192840 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:41.203339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.203883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.204651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.206142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.358179 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:41.373722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a61d959e-e189-4a50-88b8-8a7edc57c8cd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.286545 Sep 22 13:11:41.375851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 55/123] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:41 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:41.384516 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1667404-ca58-4c0c-857b-2290e332ee36"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:41.386212 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:41.396490 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.397143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.398351 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.399212 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.451055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:41.460535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7dccc9c7-8f72-4762-a239-77c383240156 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1514 microversion: 2.1 time: 0.274327 Sep 22 13:11:41.463670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 69/124] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:41 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:41.484568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-f6f9f1d4-2605-40f8-8eb4-bd1bf2ab40d4 req-724a4395-ba15-4372-a193-84bed56b54da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "name": "network-vif-plugged", "status": "completed", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:41.488032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:41.488032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:41.496337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-f6f9f1d4-2605-40f8-8eb4-bd1bf2ab40d4 req-724a4395-ba15-4372-a193-84bed56b54da service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.496715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-f6f9f1d4-2605-40f8-8eb4-bd1bf2ab40d4 req-724a4395-ba15-4372-a193-84bed56b54da service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.514546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-f6f9f1d4-2605-40f8-8eb4-bd1bf2ab40d4 req-724a4395-ba15-4372-a193-84bed56b54da service nova] Creating event network-vif-plugged:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:11:41.522839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-f6f9f1d4-2605-40f8-8eb4-bd1bf2ab40d4 req-724a4395-ba15-4372-a193-84bed56b54da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057291 Sep 22 13:11:41.523566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 70/125] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:41.530683 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:41.531857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:41.540067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.540665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.541949 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:41.542503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:41.668081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lazy-loading 'flavor' on Instance uuid 51372312-678a-4ec5-8407-7ef186a53479 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:11:42.138556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-772987a0-06c6-445d-b5c0-a76512b37656 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479/action" status: 200 len: 32 microversion: 2.1 time: 0.613571 Sep 22 13:11:42.139159 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 71/126] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:11:41 2021] POST /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479/action => generated 32 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:11:42.152115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c81f77-d526-4834-9aa4-59181b001398"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:42.153278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:42.160436 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.161090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:42.161875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.162310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:42.642412 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c31c71c0-544b-4d04-874a-00f5bf6621df tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264934 Sep 22 13:11:42.644104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 56/127] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:11:41 2021] POST /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:42.648764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:42.649463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:42.656797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.657494 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:42.660113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.660113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:42.815799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:42.825318 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:42.827638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:42.828992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-79c6ede4-dba0-4ff9-bec1-06bc94496cd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1407 microversion: 2.20 time: 0.184518 Sep 22 13:11:42.830871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 57/128] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:42 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:42.835681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:42.837236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:42.847372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.848035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:42.848672 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:42.849252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:43.013031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:43.022077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7d1e3296-4149-44b0-a158-4d5c9603a450 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.189755 Sep 22 13:11:43.025902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 58/129] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:42 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:43.032458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:43.033601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:43.041043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:43.042852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:43.042852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:43.043646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:43.270123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:43.283808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ab62411-dd96-4358-82ba-e6f64cb6043d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.251697 Sep 22 13:11:43.285344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 59/130] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:43 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:43.618310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-51b3b5e2-9187-4716-a168-17f550fb9599 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "POST /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.469522 Sep 22 13:11:43.619249 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 72/131] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:11:42 2021] POST /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8/os-volume_attachments => generated 194 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:43.847956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:43.848391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:43.855217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:43.855717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:43.856550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:43.856993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:43.990495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:43.998386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:43.999919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:44.002296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e461b4a1-9f32-4e8e-be58-4f3e18ecb76c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1599 microversion: 2.20 time: 0.158863 Sep 22 13:11:44.015663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 60/132] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:11:43 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:11:44.021277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:44.021916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:44.029789 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.030397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.031316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.031955 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.043950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:44.044687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:44.051922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.052660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.053508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.054009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.142834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-98879ad6-ace4-4503-8fde-b2be6dddb786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.125318 Sep 22 13:11:44.144015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 73/133] 10.222.0.43 () {60 vars in 1316 bytes} [Wed Sep 22 13:11:44 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:11:44.202071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:44.209323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6e2fcdbc-18df-450b-a24b-44c17ceab28d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.169093 Sep 22 13:11:44.209890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 61/134] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:44 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:44.303709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:44.304552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:44.316869 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.317890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.319009 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:44.319762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:44.600118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:44.611533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-abdb85e0-0264-463b-98dd-df83563fa14d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.313105 Sep 22 13:11:44.618732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 74/135] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:44 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:45.226404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:45.227108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:45.234008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.234460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.235288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.236307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.293771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-257b50b2-df4f-4e7d-9538-7e944bee9ddb req-507975b3-7676-4d31-8515-9a3f91032f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34469eaa-a287-41e5-a5cd-ad889e389ada", "name": "network-vif-plugged", "status": "completed", "tag": "f3ee028d-6a0d-4aa7-823b-d96fde18de61"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:45.296037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:45.296037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:45.315892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-257b50b2-df4f-4e7d-9538-7e944bee9ddb req-507975b3-7676-4d31-8515-9a3f91032f3b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.316483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-257b50b2-df4f-4e7d-9538-7e944bee9ddb req-507975b3-7676-4d31-8515-9a3f91032f3b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.330077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-257b50b2-df4f-4e7d-9538-7e944bee9ddb req-507975b3-7676-4d31-8515-9a3f91032f3b service nova] Creating event network-vif-plugged:f3ee028d-6a0d-4aa7-823b-d96fde18de61 for instance 34469eaa-a287-41e5-a5cd-ad889e389ada on hv-cinder-81000 Sep 22 13:11:45.335547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-257b50b2-df4f-4e7d-9538-7e944bee9ddb req-507975b3-7676-4d31-8515-9a3f91032f3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048971 Sep 22 13:11:45.336319 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 75/136] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:11:45.426943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:45.444059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7bdb855d-ab20-4aee-bd31-6ef12f4d03b0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.221657 Sep 22 13:11:45.446698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 62/137] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:45 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:45.635355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:45.636187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:45.642909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.644865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.644865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.644865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.973189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:45.975035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:45.976530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:45.983694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-633bc7b2-8d2a-49e7-9dd2-feaca6e9dc93 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.352870 Sep 22 13:11:45.983919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.984898 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.985075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 76/138] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:45 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:45.987175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:45.988262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:45.990297 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-bc240043-7464-421d-9142-2e7e475a0cef req-ef31539b-8914-46e1-b6ac-06d8c98b8046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:45.992067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:45.992067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:45.999874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-bc240043-7464-421d-9142-2e7e475a0cef req-ef31539b-8914-46e1-b6ac-06d8c98b8046 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:46.000576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-bc240043-7464-421d-9142-2e7e475a0cef req-ef31539b-8914-46e1-b6ac-06d8c98b8046 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:46.013488 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-bc240043-7464-421d-9142-2e7e475a0cef req-ef31539b-8914-46e1-b6ac-06d8c98b8046 service nova] Creating event network-changed:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:11:46.019987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-bc240043-7464-421d-9142-2e7e475a0cef req-ef31539b-8914-46e1-b6ac-06d8c98b8046 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033197 Sep 22 13:11:46.020736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 77/139] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:46.186092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5f018ea5-a613-4895-a701-e3fec8c00b97 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.218810 Sep 22 13:11:46.188112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 63/140] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:45 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:46.468211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:46.468953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:46.477817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:46.478383 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:46.479704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:46.480347 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:46.722703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:46.730317 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1e515ba9-71e8-4b73-8a9a-44d472ae4cc7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.267719 Sep 22 13:11:46.730900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 78/141] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:46 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:47.008157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:47.010770 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:47.030105 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.031713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.034509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.036337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.199211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:47.201519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:47.218245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.218957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.222040 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.224006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.321938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:47.340328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a10642d5-8afb-41d9-94af-163e02ae2f17 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.144912 Sep 22 13:11:47.341873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 79/142] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:47 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:47.359275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fc4ee58c-de34-4768-ac26-fd33949e308d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1363 microversion: 2.1 time: 0.361278 Sep 22 13:11:47.362808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 64/143] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:46 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:47.748571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:47.749566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:47.757012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.757467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.758243 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:47.758680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:47.919989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:47.927600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bd077694-c644-47db-b386-b2497a9f9983 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.183145 Sep 22 13:11:47.928311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 80/144] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:47 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:48.352123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:48.353174 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:48.359719 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.360163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.361125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.361556 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.378267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:48.384340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:48.385203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.385658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.386439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.386893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.432696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fa1c171f-f03a-4c94-bb00-889f47fdcda0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.084238 Sep 22 13:11:48.436111 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 65/145] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:48 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:48.529864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:48.541917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2985117a-36f6-468f-a465-639f47e29fce tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1549 microversion: 2.1 time: 0.168000 Sep 22 13:11:48.542536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 81/146] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:48 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:11:48.559523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:48.560182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:48.567593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.579382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.579382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.579382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.652489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bbcf5646-4f41-4be1-9133-49a5df3d3370 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097100 Sep 22 13:11:48.653103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 66/147] 10.222.0.43 () {58 vars in 1275 bytes} [Wed Sep 22 13:11:48 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:48.945220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:48.945749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:48.952640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.953310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:48.954634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:48.955488 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:49.099961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:49.109247 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2d53459e-3055-4068-afe0-ee957f21bf7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.167958 Sep 22 13:11:49.114665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 82/148] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:48 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:49.443947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:49.444859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:49.451073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:49.451529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:49.452446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:49.453025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:49.540599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-40cffcec-a0c5-4348-ada2-2ecbcf27f833 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.100340 Sep 22 13:11:49.541874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 67/149] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:49 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:50.130409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:50.131480 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:50.137963 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.138688 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.140479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.141125 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.320471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:50.321663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:50.335339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.335839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.336630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.337060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.346023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:50.356779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cc6eb16f-23d9-4262-963a-7bb006b332b3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.231202 Sep 22 13:11:50.362057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 83/150] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:50 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:50.371189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-d9aa46b9-240e-4d1d-baf5-5556a7afefa9 req-2b8c1f11-ad16-43e3-ba7f-fa2f44e19d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34469eaa-a287-41e5-a5cd-ad889e389ada", "tag": "f3ee028d-6a0d-4aa7-823b-d96fde18de61"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:50.375539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:11:50.375539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:11:50.392864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-d9aa46b9-240e-4d1d-baf5-5556a7afefa9 req-2b8c1f11-ad16-43e3-ba7f-fa2f44e19d53 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.393307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-d9aa46b9-240e-4d1d-baf5-5556a7afefa9 req-2b8c1f11-ad16-43e3-ba7f-fa2f44e19d53 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.406440 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-d9aa46b9-240e-4d1d-baf5-5556a7afefa9 req-2b8c1f11-ad16-43e3-ba7f-fa2f44e19d53 service nova] Creating event network-changed:f3ee028d-6a0d-4aa7-823b-d96fde18de61 for instance 34469eaa-a287-41e5-a5cd-ad889e389ada on hv-cinder-81000 Sep 22 13:11:50.413395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-d9aa46b9-240e-4d1d-baf5-5556a7afefa9 req-2b8c1f11-ad16-43e3-ba7f-fa2f44e19d53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049642 Sep 22 13:11:50.414280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 84/151] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:11:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:11:50.557395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:50.560664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:50.573918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.574999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:50.576954 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:50.577960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:53.487657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3602cca2-9698-42f7-a613-7bcc7a135755 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 3.171257 Sep 22 13:11:53.488019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 68/152] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:11:50 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:11:53.493031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:53.493722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:53.500205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:53.500652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:53.502066 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:53.502494 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:53.518785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ef3533d7-48af-49e3-b111-2eb00f824200 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 2.969144 Sep 22 13:11:53.520940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 85/153] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:50 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 2973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:53.663784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:53.672593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-13fe4397-0507-4115-9db3-b4c0f6c98ab8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.183504 Sep 22 13:11:53.673397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 69/154] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:53 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:54.498872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:54.499901 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:54.507029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.511371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.511371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.511371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.530594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:54.531288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:54.537852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.538590 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.539362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.539858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.607416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fe573380-8595-4994-83a8-de2b2c8e7f9b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.112435 Sep 22 13:11:54.609000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 86/155] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:11:54 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:11:54.649811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42080f48-2933-4423-af28-6764112ad966 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.118684 Sep 22 13:11:54.650404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 70/156] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:54 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:54.691842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:54.692140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:54.698821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.699237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.700049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:54.700481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:54.993757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:55.001939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3a501799-4a1a-4c84-b527-c2971ab53af4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.315485 Sep 22 13:11:55.002593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 87/157] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:54 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:55.619991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:55.621342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:55.628372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:55.631883 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:55.631883 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:55.631883 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:55.657743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:55.658824 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:55.664989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:55.665435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:55.666199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:55.666628 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.173127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fef4cf54-652b-4f73-a929-e2d5e5e416ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 2.349852 Sep 22 13:11:58.173127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 71/158] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:11:55 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:11:58.173127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-65581604", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "486be222-2dae-4806-b5f2-6aa278197135"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:58.174987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-137ec023-a17b-4822-8413-17ee6710a970 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 2.326668 Sep 22 13:11:58.174987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 88/159] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:55 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:58.174987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:58.174987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:58.174987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.180540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.180540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.180540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.181145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] validate_networks() for [('486be222-2dae-4806-b5f2-6aa278197135', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:11:58.181329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:58.181329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d222ddca-4f30-4dea-92b4-bdb0455f1828 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.144974 Sep 22 13:11:58.181329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 89/160] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:57 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:58.403274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:11:58.403736 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:11:58.404203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:11:58.404603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:11:58.405004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:11:58.414053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.414455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.415250 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.415707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.432472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:11:58.437426 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for user 028372696b274b29b940bf5a602c4471 and project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:11:58.448769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:11:58.451167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:11:58.686401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-622c760a-287d-4f8e-87cd-f60037207bbc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718000 Sep 22 13:11:58.691045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 72/161] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:11:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:11:58.698021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a3bbcacb-cc1f-4da8-9ed4-c43782b3ecc5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:58.698759 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a3bbcacb-cc1f-4da8-9ed4-c43782b3ecc5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:58.753172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a3bbcacb-cc1f-4da8-9ed4-c43782b3ecc5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:58.763839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a3bbcacb-cc1f-4da8-9ed4-c43782b3ecc5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1216 microversion: 2.1 time: 0.065873 Sep 22 13:11:58.763839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 90/162] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:58 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:58.977508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:58.978411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:58.985664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.986235 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.987596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:58.988140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:58.992128 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:11:58.993360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:59.000031 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.000638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.001517 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.002036 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.072401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a3980811-4452-42c4-aac5-d9ef2b1928ea tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.098631 Sep 22 13:11:59.073184 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 73/163] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:11:58 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:11:59.096553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cb345e75-d11a-441b-b574-890b67e203ef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.107867 Sep 22 13:11:59.097300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 91/164] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:11:58 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:59.147888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:59.148610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:59.155211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.155764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.157223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.157691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.298585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:59.306483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c1e0d6f-aae9-459e-9fd6-dca9262df4a9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.162570 Sep 22 13:11:59.307064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 74/165] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:59 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:11:59.777764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:11:59.788792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:11:59.788792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.788792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.788792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:11:59.789188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:11:59.851969 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:11:59.859211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-32ba79e1-7dd3-438a-92f6-465c1f2412a9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1220 microversion: 2.1 time: 0.085559 Sep 22 13:11:59.860756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 92/166] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:11:59 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:00.084574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:00.085648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:00.092470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.092917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.093682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.094179 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.107859 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:00.108769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:00.117204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.117653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.118445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.118911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.174123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-07aa183a-e4dc-4665-9128-738d6941b9fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.093183 Sep 22 13:12:00.174931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 75/167] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:00 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:00.225959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e5bd1dfa-b9fc-4ec5-b1f9-d42fceeae369 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.121769 Sep 22 13:12:00.226616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 93/168] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:00 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:00.324850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:00.325607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:00.335752 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.336385 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.337397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.337866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.473329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:00.481365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e1894172-d6af-4787-88ce-140ee7f46b81 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.160568 Sep 22 13:12:00.490810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 76/169] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:00 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:00.880532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:00.881834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:00.892893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.893656 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.894951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:00.895595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:00.962029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:00.972827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ddba093e-60bc-4986-b17b-741ed1b8f81e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1268 microversion: 2.1 time: 0.099798 Sep 22 13:12:00.973394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 94/170] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:00 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1268 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:01.185380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:01.186353 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:01.192464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.192910 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.193709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.194169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.238796 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:01.239776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:01.252106 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.252559 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.253572 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.254310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.285058 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-32343ad0-597a-4e91-b223-3ccefaab0232 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.103023 Sep 22 13:12:01.285851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 77/171] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:01 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:12:01.351450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-faea772d-1093-4a80-9c49-636d5aa62001 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.117616 Sep 22 13:12:01.354661 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 95/172] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:01 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:01.498827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:01.501262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:01.507271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.511088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.512145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.512748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.665096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:01.672959 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-806449d4-5ad0-4e40-bdf2-6c923e670873 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.178601 Sep 22 13:12:01.673538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 78/173] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:01 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:01.991553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:01.991553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:01.998292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:01.999036 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:01.999913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.000904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.203615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:02.211209 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-abd74d2c-4259-45ce-9754-edef2e24ce67 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.225589 Sep 22 13:12:02.212367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 96/174] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:01 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:02.298339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:02.299746 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:02.306998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.309594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.309594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.310172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.363376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:02.364462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:02.371039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.371514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.372806 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.372806 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.426437 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-38b27c12-e3c7-4539-8cde-e34ddbf9e71f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.132074 Sep 22 13:12:02.427343 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 79/175] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:02 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:02.470879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7ccffb3e-865c-4f55-be25-e32222c84c2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 14 microversion: 2.20 time: 0.111311 Sep 22 13:12:02.471643 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 97/176] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:02 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:02.694121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:02.694957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:02.709543 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.710064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.710905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:02.711482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:02.851334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:02.858712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2b6a6f67-5aca-4bd4-8c53-2075b6b14ccc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.168710 Sep 22 13:12:02.859281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 80/177] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:02 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:03.029406 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-91f8b8e0-1e08-4d0c-b5a6-5404cb537000 req-a65029c2-ae4e-4088-8170-d8390598c986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8369eb82-e777-4163-baea-b3cc2fa04b12", "tag": "aaae317a-63a2-4d22-ad36-3ca9211cdcbb"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:03.031270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:03.031270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:12:03.044349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-91f8b8e0-1e08-4d0c-b5a6-5404cb537000 req-a65029c2-ae4e-4088-8170-d8390598c986 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.044792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-91f8b8e0-1e08-4d0c-b5a6-5404cb537000 req-a65029c2-ae4e-4088-8170-d8390598c986 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.058247 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-91f8b8e0-1e08-4d0c-b5a6-5404cb537000 req-a65029c2-ae4e-4088-8170-d8390598c986 service nova] Creating event network-changed:aaae317a-63a2-4d22-ad36-3ca9211cdcbb for instance 8369eb82-e777-4163-baea-b3cc2fa04b12 on hv-cinder-81000 Sep 22 13:12:03.064694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-91f8b8e0-1e08-4d0c-b5a6-5404cb537000 req-a65029c2-ae4e-4088-8170-d8390598c986 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039251 Sep 22 13:12:03.065942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 98/178] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:03.234082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:03.235230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:03.242245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.242690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.243471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.244071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.415222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:03.422830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4c4217e7-1c29-4428-9651-65988f5df052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.197496 Sep 22 13:12:03.423408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 81/179] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:03 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:03.439327 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:03.440377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:03.447573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.448796 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.450129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.450777 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.497305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:03.498249 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:03.511464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.511464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.511464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.511464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.578389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-678b6739-bff5-4c25-a9ee-010b221e18d2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.143861 Sep 22 13:12:03.582269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 99/180] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:03 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:03.615397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1f770867-968e-4e71-9c41-39af1b094ec4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 2989 microversion: 2.20 time: 0.131071 Sep 22 13:12:03.616021 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 82/181] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:03 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 2989 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:12:03.878028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:03.878157 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:03.885178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.885624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:03.886394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:03.886824 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.100062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:04.108726 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-149f8190-f225-40e2-8caa-663d710e5f1e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.236542 Sep 22 13:12:04.117389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 100/182] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:03 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:04.439916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:04.440593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:04.447097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.447572 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.448322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.448745 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.590654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:04.591648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:04.592422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:04.599309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.599723 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.600530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.601292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.602067 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2a9d8476-a195-434e-9d20-c9911e73aa3a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.166051 Sep 22 13:12:04.602644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 83/183] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:04 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:04.626635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:04.627677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:04.634011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.634445 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.635207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:04.635669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:04.779161 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4d03a1cc-33c7-40af-b79d-a9faf1692b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 6451 microversion: 2.20 time: 0.156086 Sep 22 13:12:04.782610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 84/184] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:04 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 6451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:12:04.783950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1e32c980-4a89-45ca-9b4e-1653defb6631 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.196659 Sep 22 13:12:04.784661 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 101/185] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:04 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:12:05.128404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:05.129011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:05.135643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.141720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.141720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.141720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.261339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:05.268885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7330e1db-8090-44a7-9240-435f394d4834 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.145233 Sep 22 13:12:05.269617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 85/186] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:05 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:05.619471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:05.620163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:05.626943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.627389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.628301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.628728 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.759537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:05.766897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fe7c48f4-35dd-49f6-8e94-b5dcffc85052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.151552 Sep 22 13:12:05.767511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 102/187] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:05 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:05.790528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:05.791594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:05.794482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:05.795277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:05.799063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.799670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.800608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.801088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.802722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.802912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:05.803632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:05.804210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:08.299094 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5ce428aa-d931-4c72-86da-8853e3154f1b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 15064 microversion: 2.20 time: 2.512477 Sep 22 13:12:08.300425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b5f0405b-b7ff-4e76-8e95-19f1b0004b94 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 2.509627 Sep 22 13:12:08.303758 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 103/188] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:05 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:12:08.303904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 86/189] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:05 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 15064 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:08.307269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:08.308173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:08.308988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:08.309827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:08.315241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:08.316746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:08.317634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:08.318104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:08.322417 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:08.322976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:08.323960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:08.324486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:08.448357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:08.456451 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2a3d8784-8780-4d5e-899a-0f1e01d0505c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.153673 Sep 22 13:12:08.456647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:08.456940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 104/190] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:08 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:08.463896 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3dda99b7-7f42-4dd9-aa21-0cb68f680cb0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.158971 Sep 22 13:12:08.464659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 87/191] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:08 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:09.315594 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:09.317153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.319500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:09.320518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.329415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.329600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.331876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.335579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.336056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.336056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.336324 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.336324 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.471121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8fedce0e-8c1b-4619-bf57-8b2e5a9efd1f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.163495 Sep 22 13:12:09.471825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 88/192] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:09 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:09.479626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:09.480203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.487822 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.488270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.488470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b4aeb5ac-6c61-40b8-9ef8-b7ae31de4531 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 17345 microversion: 2.20 time: 0.181848 Sep 22 13:12:09.489046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.489474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.489820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 105/193] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:09 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 17345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:09.494715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:09.495413 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.503268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.507407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.507407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.507407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.518323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:12:09.740577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:09.750108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ba3b6a57-928c-42e2-b54f-163cde3c6c18 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.259011 Sep 22 13:12:09.750795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 106/194] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:09 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:09.759722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:09.759722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.762483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.763129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.764166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.764601 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.950847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-966f2cce-adea-4a14-910d-94c4153cd835 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 204 len: 0 microversion: 2.1 time: 0.475127 Sep 22 13:12:09.951449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 89/195] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:12:09 2021] DELETE /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:12:09.974238 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:09.975240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:09.981374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:09.981980 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.982437 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.983330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:09.983684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:09.989262 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b6a150cc-1bc0-40d6-97a1-033edcabe198 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.237201 Sep 22 13:12:09.989944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 107/196] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:09 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:10.113029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:10.120568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a729e7e-3309-411f-aada-8086875dc6de tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1552 microversion: 2.1 time: 0.152510 Sep 22 13:12:10.121130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 90/197] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:09 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:10.481359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:10.482315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:10.488890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.489332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.490123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.498727 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.500812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:10.501948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:10.508855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.513804 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.514625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.515056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.586823 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-af890b53-770d-403b-9e11-0f49c4731b9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.109002 Sep 22 13:12:10.587612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 108/198] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:10 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:10.604348 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0d0d99dd-7085-4a15-9cdc-8b29de61f14e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 17443 microversion: 2.20 time: 0.107813 Sep 22 13:12:10.605018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 91/199] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:10 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 17443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:10.766691 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:10.767380 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:10.774648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.775104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.775967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:10.776404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:10.909443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:10.918074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c166cb5a-a94a-4e63-8b7a-24075da3fb5a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.155465 Sep 22 13:12:10.918811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 109/200] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:10 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:11.011878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:11.012569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:11.019862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.022422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.022422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.022422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.138370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:11.138980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:11.143868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:11.145038 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.145489 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.146447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.146891 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.151058 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-62d9243c-8d0b-4f85-8bc9-8d45a68ea020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.143374 Sep 22 13:12:11.151651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 92/201] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:11 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:11.273484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:11.282164 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-42c713de-7171-4f78-af6a-eccefb145c36 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1552 microversion: 2.1 time: 0.147938 Sep 22 13:12:11.282750 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 110/202] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:11 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:11.397536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-2d6fd562-5f74-4971-a4aa-13e136a621c1 req-cb3bbd62-d1a9-478e-b661-22af7fe4ffd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8369eb82-e777-4163-baea-b3cc2fa04b12", "name": "network-vif-plugged", "status": "completed", "tag": "aaae317a-63a2-4d22-ad36-3ca9211cdcbb"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:11.399035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:11.399035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:12:11.406039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2d6fd562-5f74-4971-a4aa-13e136a621c1 req-cb3bbd62-d1a9-478e-b661-22af7fe4ffd9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.407028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2d6fd562-5f74-4971-a4aa-13e136a621c1 req-cb3bbd62-d1a9-478e-b661-22af7fe4ffd9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.420365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-2d6fd562-5f74-4971-a4aa-13e136a621c1 req-cb3bbd62-d1a9-478e-b661-22af7fe4ffd9 service nova] Creating event network-vif-plugged:aaae317a-63a2-4d22-ad36-3ca9211cdcbb for instance 8369eb82-e777-4163-baea-b3cc2fa04b12 on hv-cinder-81000 Sep 22 13:12:11.425937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-2d6fd562-5f74-4971-a4aa-13e136a621c1 req-cb3bbd62-d1a9-478e-b661-22af7fe4ffd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032000 Sep 22 13:12:11.426541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 93/203] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:11.598831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:11.599851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:11.605872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.606321 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.610836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.610836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.617123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:11.618430 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:11.625905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.626354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.627130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.627591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.721266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b7ee7a46-d095-4283-a846-0d97fdac47f6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.126537 Sep 22 13:12:11.722286 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 111/204] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:11 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:11.746000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-53bc6102-dba3-4c2b-9f19-1b8f13524e94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 17498 microversion: 2.20 time: 0.133386 Sep 22 13:12:11.746831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 94/205] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:11 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 17498 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:11.935123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:11.935920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:11.951392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.956526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:11.958008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:11.958114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.102704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:12.120074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f10b485f-249b-42c5-9498-b4587eed85e4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.181450 Sep 22 13:12:12.120074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 112/206] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:11 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:12.168677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:12.169280 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:12.176203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.176636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.177385 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.177811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.299693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:12.300577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:12.305308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:12.306805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.307484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.308339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.308862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.317808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b07c4da7-9da4-41dd-b317-39b92846d0e2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.151725 Sep 22 13:12:12.317808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 95/207] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:12 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:12.447987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:12.458491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4fb8c52d-9e96-4eef-90ab-ef5f025128ec tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1552 microversion: 2.1 time: 0.163172 Sep 22 13:12:12.459281 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 113/208] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:12 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:12.732195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:12.733128 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:12.739751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.740192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.741042 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.741476 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.757863 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:12.758901 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:12.764901 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.765885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.766650 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:12.767085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:12.838368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-10359740-65b5-44f6-b9bf-ab7566162317 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.109782 Sep 22 13:12:12.839367 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 96/209] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:12 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:12.856580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4d4236d7-0302-41b8-8d2a-69382ad86fbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 17931 microversion: 2.20 time: 0.101393 Sep 22 13:12:12.860307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 114/210] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:12 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 17931 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:13.135308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:13.136107 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:13.143654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.144099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.144874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.145305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.288353 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:13.295595 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9241c0a1-7114-4cbb-a1ce-130cb6d2d8e6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1316 microversion: 2.1 time: 0.164402 Sep 22 13:12:13.296157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 97/211] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:13 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:13.334752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:13.335461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:13.341917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.342364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.345854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.345854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.492758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:13.493791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:13.509512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.511379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.512873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.513539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.537893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:13.551962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f57745f3-f7f9-4321-ba0c-c4a9dde618b4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.221134 Sep 22 13:12:13.552743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 115/212] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:13 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:13.642303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:13.650393 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e988609a-65e5-469c-a1a3-8de7b31fe0a6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1552 microversion: 2.1 time: 0.173613 Sep 22 13:12:13.650955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 98/213] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:13 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:13.774275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-25458157-0b9c-4467-934f-ce9337c26061 req-99c7b65b-8375-41ca-a090-4ad1ed4c2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb6655-1b93-4b10-a1fe-b73fd3adaff8", "name": "network-vif-deleted", "tag": "a2bbb5b2-cff5-4e17-b8fc-9bf130271e67"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:13.776235 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:13.776235 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:12:13.783652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-25458157-0b9c-4467-934f-ce9337c26061 req-99c7b65b-8375-41ca-a090-4ad1ed4c2c64 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.784096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-25458157-0b9c-4467-934f-ce9337c26061 req-99c7b65b-8375-41ca-a090-4ad1ed4c2c64 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.795380 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-25458157-0b9c-4467-934f-ce9337c26061 req-99c7b65b-8375-41ca-a090-4ad1ed4c2c64 service nova] Creating event network-vif-deleted:a2bbb5b2-cff5-4e17-b8fc-9bf130271e67 for instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 on hv-cinder-81000 Sep 22 13:12:13.801094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-25458157-0b9c-4467-934f-ce9337c26061 req-99c7b65b-8375-41ca-a090-4ad1ed4c2c64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 Sep 22 13:12:13.801730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 116/214] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:13.849857 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:13.850859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:13.856749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.857227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.857945 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.858387 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.868839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:13.869858 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:13.876011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.876454 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.877218 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:13.877643 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:13.951253 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b5730264-580a-47f7-abb7-19907137910d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 14 microversion: 2.1 time: 0.105675 Sep 22 13:12:13.954724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 99/215] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:13 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:14.007790 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-07feffef-0da3-4af4-a571-b6ed33867924 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 18499 microversion: 2.20 time: 0.142774 Sep 22 13:12:14.009603 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 117/216] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:13 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 18499 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:14.312548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:14.313273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.319705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.320146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.320898 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.321323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.445414 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:14.456741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cabd490b-aebe-493e-8dde-3e38de5c70c8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1507 microversion: 2.1 time: 0.148178 Sep 22 13:12:14.458152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 100/217] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:14 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:14.479963 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1667404-ca58-4c0c-857b-2290e332ee36"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:14.481285 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.488252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.488693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.489456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.489883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.569051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:14.569659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.576104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.576541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.578531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.579009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.596817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Invalid volume: volume a1667404-ca58-4c0c-857b-2290e332ee36 is already attached to instances: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 Sep 22 13:12:14.597415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 400 to user: Invalid volume: volume a1667404-ca58-4c0c-857b-2290e332ee36 is already attached to instances: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:14.598246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5e6bd818-dafb-4321-b89f-fa3d54fe0c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122820 Sep 22 13:12:14.598917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 118/218] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:12:14 2021] POST /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:12:14.668057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:14.668861 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.677365 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.677859 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.678833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.679468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.732912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.733351 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.733897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lazy-loading 'fault' on Instance uuid b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:14.752973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:14.755534 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dfde410b-8a67-43b8-9f85-4e1fb25804bc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.190503 Sep 22 13:12:14.756121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 101/219] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:14 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:14.760989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:14.761480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.770286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.771099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.772006 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.772620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.784190 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:14.792222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7cf1f742-f677-442a-b524-fd100951d6e6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1350 microversion: 2.1 time: 0.127942 Sep 22 13:12:14.792781 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 119/220] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:14 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:14.909278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'services' on Instance uuid 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:14.962435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:14.963332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:14.969228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.969665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:14.970500 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:14.970934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.088411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d0c703d8-2a54-4407-a516-9588058e9826 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 4926 microversion: 2.1 time: 0.129199 Sep 22 13:12:15.091599 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 120/221] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:14 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 4926 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:15.093930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:15.094940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:15.101479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.101917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.102681 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.103104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.217061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bb835b76-e297-4086-9c01-257f7a14999b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 20018 microversion: 2.20 time: 0.125856 Sep 22 13:12:15.220812 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 121/222] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:15 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 20018 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:15.270162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd7032e5-1e82-4e36-8d58-e28a1e4f23e2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments/a1667404-ca58-4c0c-857b-2290e332ee36" status: 202 len: 0 microversion: 2.1 time: 0.512028 Sep 22 13:12:15.270972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 102/223] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:12:14 2021] DELETE /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments/a1667404-ca58-4c0c-857b-2290e332ee36 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:15.280766 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:15.282015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:15.292720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.293580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.294378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.294805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.329926 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-299c7d2d-b26b-4009-ba9c-4963b5085a94 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054195 Sep 22 13:12:15.330491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 122/224] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:15 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:15.772120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:15.772818 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:15.781887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.782339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.783120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.783595 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.820371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:15.821057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:15.829332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.829332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.829332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.829332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.869576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:15.870137 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:15.870675 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lazy-loading 'fault' on Instance uuid b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:15.912347 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:15.913890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1971d67580b47019bb4699566389fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e2fa50df244271b7c1994faa0b6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:15.921963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f54c0b62-acad-491d-8ded-a3b38041e029 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.153371 Sep 22 13:12:15.926246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 103/225] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:15 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:15.926362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d8d12f03-8fcd-4913-9615-be2c21680672 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 200 len: 1350 microversion: 2.1 time: 0.106098 Sep 22 13:12:15.926362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 123/226] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:15 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:16.099558 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:16.107959 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:16.108194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.108879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.110031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.110569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.228375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-66dd8ed3-d3a8-47c2-82cc-d2552b13a7ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 6882 microversion: 2.1 time: 0.132219 Sep 22 13:12:16.228901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 104/227] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:16 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 6882 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:16.234330 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:16.235172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:16.241184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.241709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.242401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.242832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.341878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:16.343223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:16.349733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.350262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.351108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.351676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.356090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4cdc78b4-9238-4099-b78c-665284d94300 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 21512 microversion: 2.20 time: 0.125523 Sep 22 13:12:16.356936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 124/228] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:16 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 21512 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:16.384782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9b9c2cf7-818a-465e-8462-65a3d654f8aa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047245 Sep 22 13:12:16.385354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 105/229] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:16 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:16.939539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:16.940146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:16.941442 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:16.942734 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:16.946280 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.946659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.947419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.947949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.949732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.950468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.951124 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:16.951668 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:16.964476 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] HTTP exception thrown: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. Sep 22 13:12:16.964476 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Returning 404 to user: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:16.965337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-48dd7bfb-b061-4f83-86ba-c1ab625f532c tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 404 len: 111 microversion: 2.1 time: 0.030149 Sep 22 13:12:16.965852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 106/230] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:16 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:12:17.086123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:17.087013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:17.087462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:17.093047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.093497 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.094291 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.094716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.095034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ba1d6e78-9d45-4f2b-96f7-39c553bc5e86 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.160517 Sep 22 13:12:17.095631 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 125/231] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:16 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:17.109812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] HTTP exception thrown: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. Sep 22 13:12:17.110399 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Returning 404 to user: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:17.111221 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c8ce3fa1-6f18-4d44-ac36-d8d92c8d6ad6 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028946 Sep 22 13:12:17.112625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 107/232] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:17 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:12:17.241331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:17.246701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:17.261900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.261900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.261900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.261900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.375083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:17.376506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:17.380362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c84c7f0a-edb8-41a2-a1f0-14670e6061fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 11371 microversion: 2.1 time: 0.143474 Sep 22 13:12:17.385396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 126/233] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:17 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 11371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:17.385642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.385642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.385642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.385642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.404186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:17.406145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:17.418583 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.419340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.420806 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:17.422122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:17.454742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dee2d06f-7cbb-403d-b6c3-24729b488aaa tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060796 Sep 22 13:12:17.455309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 127/234] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:17 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:17.490606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ce08393f-87e6-400e-8e54-96fe627a5530 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 22705 microversion: 2.20 time: 0.119596 Sep 22 13:12:17.491299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 108/235] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:17 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 22705 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:17.752261 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521389960", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "486be222-2dae-4806-b5f2-6aa278197135"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:17.815294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] validate_networks() for [('486be222-2dae-4806-b5f2-6aa278197135', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:12:18.114839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:18.115571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.121688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.122135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.123223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.123849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.252088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:18.268853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c96bca3c-f8e1-4f73-af42-bbd7473cb005 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.158483 Sep 22 13:12:18.277337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 109/236] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:18 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:18.328047 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:12:18.329482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:12:18.331008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:12:18.331441 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:12:18.332570 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:12:18.342080 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.342519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.344224 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.346097 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.363765 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:18.367995 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for user 028372696b274b29b940bf5a602c4471 and project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:18.379206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:12:18.381711 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:12:18.393736 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:18.394791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.402342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.402880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.403708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.404167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.498644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-81173d0a-3dc0-48cf-add6-938beed1ba7c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 15025 microversion: 2.1 time: 0.109152 Sep 22 13:12:18.502915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 110/237] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:18 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 15025 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:18.506008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:18.513296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.513640 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.514090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.515515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.515962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.533973 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6b100dfd-5ade-49d1-a489-9cbf380608c5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785067 Sep 22 13:12:18.535709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 128/238] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:12:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:12:18.547326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cebdabb7-1130-4892-a99d-05f6c726b669 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:18.547991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cebdabb7-1130-4892-a99d-05f6c726b669 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.729610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cebdabb7-1130-4892-a99d-05f6c726b669 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:18.738369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cebdabb7-1130-4892-a99d-05f6c726b669 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1218 microversion: 2.1 time: 0.195229 Sep 22 13:12:18.738984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 129/239] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:18 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:18.753135 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:18.753635 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.806899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-306aacdc-3a4d-4565-9cc5-c4e76d74473a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 23390 microversion: 2.20 time: 0.304342 Sep 22 13:12:18.807885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 111/240] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:18 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 23390 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:18.933216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.933657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.934884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.934884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.948625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] HTTP exception thrown: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. Sep 22 13:12:18.949228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Returning 404 to user: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:18.950052 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bd521817-5a1e-4c62-a21d-de0aefb18dda tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 404 len: 111 microversion: 2.1 time: 0.201662 Sep 22 13:12:18.951088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 130/241] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:12:18 2021] DELETE /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:12:18.961185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:18.961884 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] [instance: b0bb6655-1b93-4b10-a1fe-b73fd3adaff8] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:18.968453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.968943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.969710 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:18.970122 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:18.987662 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] HTTP exception thrown: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. Sep 22 13:12:18.988280 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] Returning 404 to user: Instance b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:18.989241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-979ca00e-b66d-4124-80d3-ce0a551c1182 tempest-DeleteServersTestJSON-2010014824 tempest-DeleteServersTestJSON-2010014824-project] 10.222.0.43 "GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8" status: 404 len: 111 microversion: 2.1 time: 0.032039 Sep 22 13:12:18.990386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 112/242] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:18 2021] GET /compute/v2.1/servers/b0bb6655-1b93-4b10-a1fe-b73fd3adaff8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:12:19.284858 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:19.285451 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:19.293645 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.294639 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.295966 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.297581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.518757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:19.519736 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:19.533710 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.534168 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.537992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.538836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.628979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3c16fb9f-f73d-4971-937b-d188594b0f2a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 18030 microversion: 2.1 time: 0.122392 Sep 22 13:12:19.629620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 113/243] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:19 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 18030 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:19.728779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:19.737078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-837e4c40-bbc6-43b3-9f06-d7789da8c625 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.456686 Sep 22 13:12:19.737648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 131/244] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:19 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:19.755121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:19.755838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:19.762552 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.762964 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.763771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.764222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.822587 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:19.824773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:19.832549 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.833332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.834318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:19.834934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:19.840971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:19.851625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6e5e8f32-11e3-409a-b176-1505342f4f6a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1222 microversion: 2.1 time: 0.099751 Sep 22 13:12:19.853312 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 114/245] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:19 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:19.919983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-988e84ce-6829-498c-bae3-33f83023cc1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 24413 microversion: 2.20 time: 0.101378 Sep 22 13:12:19.920616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 132/246] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:19 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 24413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:20.641151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:20.642124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:20.658402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.658844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.659817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.660400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.755030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:20.755990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:20.758256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8f586bb9-8602-45e8-a3ae-8bf7b8ddc447 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 18449 microversion: 2.1 time: 0.121098 Sep 22 13:12:20.758905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 115/247] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:20 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 18449 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:20.763120 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.767684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.767684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.767684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.876001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:20.877852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:20.895301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.896070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.897502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.902252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.919292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:20.939721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-56816fe8-f92c-4895-ac23-2502931f6581 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.177954 Sep 22 13:12:20.941021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 133/248] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:20 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:20.946364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:20.947767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:20.958017 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.958588 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.971275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:20.973387 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:20.976736 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:20.981759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8a7862c1-6288-41fa-a096-a1207894aed5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1270 microversion: 2.1 time: 0.116018 Sep 22 13:12:20.982325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 116/249] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:20 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:21.074316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bb2dca69-f32c-4f76-857a-b3368156e722 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 25348 microversion: 2.20 time: 0.131652 Sep 22 13:12:21.074954 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 134/250] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:20 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 25348 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:21.775810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:21.776643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:21.785705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:21.786436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:21.787217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:21.787687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:21.882982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-23e4ffa6-759f-4e6d-95da-db02bf995d44 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 19446 microversion: 2.1 time: 0.111011 Sep 22 13:12:21.896802 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 117/251] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:21 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 19446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:21.958827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:21.959453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:21.966184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:21.966626 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:21.967405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:21.968465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:21.999573 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:22.000621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:22.010081 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.010708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:22.011817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.012401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:22.138966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:22.151568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9fa328e8-b3b7-4827-9b8e-4f4b54978862 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1276 microversion: 2.1 time: 0.155846 Sep 22 13:12:22.152500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 118/252] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:21 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:22.162509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:22.163457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:22.177000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.177629 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:22.178850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.179286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:22.241373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:22.249526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-50a2aaf5-3014-4972-bb0b-0f50eb931542 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.294574 Sep 22 13:12:22.250096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 135/253] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:21 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:22.285201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-11f5c45f-f317-4c0c-92e8-ccc7e30b0786 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 26063 microversion: 2.20 time: 0.131301 Sep 22 13:12:22.285899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 119/254] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:22 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 26063 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:22.299091 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-823275826", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "d0a1aecb-1239-48e9-9116-fc0789f6366d"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:22.353464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] validate_networks() for [('d0a1aecb-1239-48e9-9116-fc0789f6366d', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:12:22.671894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2c12beb2-d3af-43ce-b398-2c93a8f9b036 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Action: 'create', calling method: .version_select at 0x7fa7183ce3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-64483634"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:22.973494 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:12:22.973947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:12:22.974430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:12:22.974845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:12:22.975252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:12:22.985318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.985760 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:22.986558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:22.987085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.004160 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Getting quotas for project dc99723145834860a6127632c31447c4. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:23.008500 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Getting quotas for user b5b51719cefc4d2d94d766b18ffab5fb and project dc99723145834860a6127632c31447c4. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:23.020140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:12:23.022446 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:12:23.139843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0ff3f00e-443c-47ec-883c-fc16010498fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845040 Sep 22 13:12:23.140486 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 136/255] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:12:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:12:23.145530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:23.146030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:23.152153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.152651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.153425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.153872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.242042 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ef1253ea-9650-42ad-8416-ce0133841ad8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 22015 microversion: 2.1 time: 0.100295 Sep 22 13:12:23.245918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 137/256] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:23 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 22015 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:23.252360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a3db7d3c-3789-413d-bef0-47a75d092163 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:23.253397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a3db7d3c-3789-413d-bef0-47a75d092163 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:23.339022 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a3db7d3c-3789-413d-bef0-47a75d092163 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:23.346713 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a3db7d3c-3789-413d-bef0-47a75d092163 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1213 microversion: 2.1 time: 0.098771 Sep 22 13:12:23.347648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 138/257] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:23 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:23.352025 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:23.352700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:23.361170 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.361642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.362435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.362883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.368762 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2c12beb2-d3af-43ce-b398-2c93a8f9b036 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.830241 Sep 22 13:12:23.369499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 120/258] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Sep 22 13:12:22 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 832 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 22 13:12:23.373849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:23.374793 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:23.383481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.383781 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.384648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.385629 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.515670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:23.523804 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-03939212-b537-469a-a4ef-304de736f48b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.153332 Sep 22 13:12:23.524422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 121/259] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:23 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:23.529125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:23.530994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:23.537381 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.537819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.538612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.539038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.585881 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:23.595613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e99a0172-71e2-4355-9cce-64c0a3f36398 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.245511 Sep 22 13:12:23.595613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 139/260] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:23 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:23.599388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4889be4b-404d-4eb9-b8e0-52f7a029607f tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7185429d0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:23.642716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-78457303-c240-4185-af34-2604ad0cc339 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 26917 microversion: 2.20 time: 0.117024 Sep 22 13:12:23.643576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 122/261] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:23 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 26917 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:23.659042 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4889be4b-404d-4eb9-b8e0-52f7a029607f tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 200 len: 343 microversion: 2.1 time: 0.063101 Sep 22 13:12:23.659647 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 140/262] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:12:23 2021] GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 343 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:23.697520 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-fd945e93-b8f3-40dc-8536-7514f8f83c17 req-67ac5954-3191-412e-9a3f-fe9baaa5021f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc54643-cc02-4783-b19d-488a79688fba", "tag": "61212e42-5473-4004-80a0-373d6f55f8f2"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:23.699276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:23.699276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:12:23.707578 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fd945e93-b8f3-40dc-8536-7514f8f83c17 req-67ac5954-3191-412e-9a3f-fe9baaa5021f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:23.708015 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fd945e93-b8f3-40dc-8536-7514f8f83c17 req-67ac5954-3191-412e-9a3f-fe9baaa5021f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:23.719062 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-fd945e93-b8f3-40dc-8536-7514f8f83c17 req-67ac5954-3191-412e-9a3f-fe9baaa5021f service nova] Creating event network-changed:61212e42-5473-4004-80a0-373d6f55f8f2 for instance 1dc54643-cc02-4783-b19d-488a79688fba on hv-cinder-81000 Sep 22 13:12:23.723658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-fd945e93-b8f3-40dc-8536-7514f8f83c17 req-67ac5954-3191-412e-9a3f-fe9baaa5021f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 Sep 22 13:12:23.728063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 123/263] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:24.259046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:24.260771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:24.284649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.285172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.286435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.287184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.365241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:24.366133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:24.373246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.374917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.375255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.375879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.385720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-aebd23b0-7f45-4467-b33b-4568408ba8e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 23130 microversion: 2.1 time: 0.133889 Sep 22 13:12:24.386779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 141/264] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:24 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 23130 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:24.438973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:24.447500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c01ad8d7-12de-45b8-94ed-8486b6025b62 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1217 microversion: 2.1 time: 0.087092 Sep 22 13:12:24.448095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 124/265] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:24 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:24.542367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:24.543198 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:24.550937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.551647 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.552431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.553076 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.610653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:24.611183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:24.617545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.617995 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.618798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.619500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.751862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:24.759689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:24.763055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fa653936-5584-4fce-9ef8-5a31fe3c0e82 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.224904 Sep 22 13:12:24.768104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8bffef4b-a880-40d4-aa1e-e10335aae5e0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.161810 Sep 22 13:12:24.769158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 125/266] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:24 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:24.772961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 142/267] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:24 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:24.776060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:24.777124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:24.781748 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-16f0538e-7fff-4c26-96d4-463af8468291 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7184f6af0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:24.785508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.786326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.787208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:24.787788 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:24.837422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-16f0538e-7fff-4c26-96d4-463af8468291 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 200 len: 344 microversion: 2.1 time: 0.063153 Sep 22 13:12:24.842268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 143/268] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:12:24 2021] GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:24.848939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7077202b-0d67-46dd-910f-949e4ce61560 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Action: 'create', calling method: .version_select at 0x7fa7184ca3a0>, body: {"snapshot": {"volume_id": "7006b019-5d50-43d3-b23f-e91b7a67aca1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1833812512"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:24.886967 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-48dff512-d616-4a30-a2bd-ab57898d9b7a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 27621 microversion: 2.20 time: 0.116417 Sep 22 13:12:24.887655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 126/269] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:24 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 27621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:25.305274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7077202b-0d67-46dd-910f-949e4ce61560 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.459751 Sep 22 13:12:25.305923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 144/270] 10.222.0.43 () {60 vars in 1162 bytes} [Wed Sep 22 13:12:24 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:25.316023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42c842e2-198b-4715-8e0c-89c78750d5c2 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa71830f5e0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.346480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42c842e2-198b-4715-8e0c-89c78750d5c2 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 200 len: 287 microversion: 2.1 time: 0.034291 Sep 22 13:12:25.347098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 127/271] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:25.356457 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5663eb4c-ed7a-4128-93d2-d994fa2880a4 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7183bbca0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.386470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5663eb4c-ed7a-4128-93d2-d994fa2880a4 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033398 Sep 22 13:12:25.386935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 145/272] 10.222.0.43 () {58 vars in 1140 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:25.398227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5777d26f-9632-46e1-92ca-c66aa02b4a80 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7183fc9d0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.401018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:25.403030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:25.409732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.410287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.411547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.412369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.429333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5777d26f-9632-46e1-92ca-c66aa02b4a80 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 200 len: 287 microversion: 2.1 time: 0.035070 Sep 22 13:12:25.430190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 128/273] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:25.466772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.466772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:25.473800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.474621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.475033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.475498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.529522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-75dc42c2-bd9b-4d16-9646-1e2ae88808e0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 24080 microversion: 2.1 time: 0.132437 Sep 22 13:12:25.530222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 146/274] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:25 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 24080 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:25.543333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:25.551675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-da0ab195-eb78-4140-9f7c-4f641e523b08 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1265 microversion: 2.1 time: 0.090319 Sep 22 13:12:25.552675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 129/275] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:25.780654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.781513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:25.784963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:25.786571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:25.789113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.789589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.790511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.791044 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.793786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.801237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.801237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.801237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.923157 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:25.923326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:25.930666 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b2bf6503-2a3f-48fd-86d8-3fd16f1a954d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.150414 Sep 22 13:12:25.930865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5136a1c1-db7d-485a-9886-c7bbf1976f50 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.154158 Sep 22 13:12:25.931152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 130/276] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:25.931284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 147/277] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:25 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:25.940709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:25.940709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:25.944233 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.944678 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:25.945443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:25.945878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:26.446755 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-58c57a76-c111-4daf-bd31-db921f0665b5 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718439670>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:26.476132 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-58c57a76-c111-4daf-bd31-db921f0665b5 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 200 len: 287 microversion: 2.1 time: 0.032963 Sep 22 13:12:26.476730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 131/278] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:26 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:26.544760 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:26.545670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:26.553158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:26.553603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:26.554413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:26.554849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.661636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0898e01f-232f-484c-8ac8-d02cbb8eca91 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 27350 microversion: 2.1 time: 2.120174 Sep 22 13:12:28.663621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 132/279] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:26 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 27350 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:28.670034 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:28.671108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:28.681635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.682460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.683506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.683669 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6a5ee83b-cbf2-4ae3-9f83-839c928cbc16 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28271 microversion: 2.20 time: 2.751108 Sep 22 13:12:28.684766 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 148/280] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:25 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28271 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:28.700080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.701220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:28.701989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:28.714065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.714505 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.715304 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.715743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.805232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:28.816240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b494bce9-72ad-4f38-83bb-84a0a1560460 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1273 microversion: 2.1 time: 0.151058 Sep 22 13:12:28.817090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 133/281] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:28 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:28.835255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:28.836269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:28.843314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.845043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:28.846852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:28.847521 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.038203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:29.055329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-46c1c017-a9f2-4a81-bfb1-a99a0a32a048 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.366973 Sep 22 13:12:29.057754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 149/282] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:28 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:29.070386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-caedab11-2b49-4601-96f6-ba588727843a tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7184f6af0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:29.109374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-caedab11-2b49-4601-96f6-ba588727843a tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 200 len: 288 microversion: 2.1 time: 0.041110 Sep 22 13:12:29.109653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 150/283] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:29 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:29.125856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d179e58e-5600-4547-94e5-3b4583f544b7 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718415ca0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:29.261574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:29.271955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a03925c3-c693-4855-9e1e-49c57b2232a0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.450088 Sep 22 13:12:29.276659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 134/284] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:28 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:29.330003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d179e58e-5600-4547-94e5-3b4583f544b7 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 202 len: 0 microversion: 2.1 time: 0.212682 Sep 22 13:12:29.335519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 151/285] 10.222.0.43 () {58 vars in 1254 bytes} [Wed Sep 22 13:12:29 2021] DELETE /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:29.339075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-289557bb-af97-4eb2-b76c-36f7dcb0e017 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718439f70>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:29.371147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-289557bb-af97-4eb2-b76c-36f7dcb0e017 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 200 len: 287 microversion: 2.1 time: 0.035972 Sep 22 13:12:29.372989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 135/286] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:29 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:29.674333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:29.675305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:29.682933 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.683369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.684446 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.685481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.701873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:29.703018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:29.716777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.717584 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.720082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.720694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.797526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-424bd724-b960-4c9b-8c9b-81b9279c1240 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 27520 microversion: 2.1 time: 0.126548 Sep 22 13:12:29.798628 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 152/287] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:29 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 27520 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:29.835357 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-119a05e9-0a78-4a3f-bb96-04ac177965e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28271 microversion: 2.20 time: 0.139904 Sep 22 13:12:29.835762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:29.840032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:29.840225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 136/288] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:29 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:29.851911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.852348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:29.853313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:29.853748 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.076774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:30.077555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:30.086518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.087486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.088418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.088868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.094287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:30.103809 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-24e01540-5023-4177-8f9c-4655c47c46cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.272263 Sep 22 13:12:30.115657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 153/289] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:29 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:30.294697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:30.295540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:30.309266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.310456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.311373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.313545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.423103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:30.435974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cb0a90ed-502e-46ce-aaef-5b25865c3351 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.363950 Sep 22 13:12:30.437263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 137/290] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:30 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:30.452019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7ec4c900-bdea-458d-9305-ba13983809b8 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7185a6790>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:30.486782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-7ec4c900-bdea-458d-9305-ba13983809b8 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] HTTP exception thrown: Snapshot 38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e could not be found. Sep 22 13:12:30.487382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7ec4c900-bdea-458d-9305-ba13983809b8 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Returning 404 to user: Snapshot 38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:30.488273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7ec4c900-bdea-458d-9305-ba13983809b8 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e" status: 404 len: 111 microversion: 2.1 time: 0.049209 Sep 22 13:12:30.488833 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 138/291] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Sep 22 13:12:30 2021] GET /compute/v2.1/os-snapshots/38bb2a94-0070-4bb0-bfcb-fa2e180a3c2e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:12:30.497875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42f529bb-f73d-4ff3-b496-2599e709574d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718439940>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:30.777429 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42f529bb-f73d-4ff3-b496-2599e709574d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 202 len: 0 microversion: 2.1 time: 0.283866 Sep 22 13:12:30.778414 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 139/292] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:12:30 2021] DELETE /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:30.801408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9aea2ef0-3e4f-419b-a818-98408aef170b tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718510f70>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:30.972456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9aea2ef0-3e4f-419b-a818-98408aef170b tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 200 len: 343 microversion: 2.1 time: 0.188820 Sep 22 13:12:30.977424 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 140/293] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:12:30 2021] GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 343 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:30.979408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:30.980799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:30.989759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.990139 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.990784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:30.991392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:30.999515 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:31.009817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fc609a3b-8d71-4ede-aae0-2941da0fbf38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.720296 Sep 22 13:12:31.011069 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 154/294] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:30 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:31.017983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:31.019073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:31.031758 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.033959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.034787 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.035225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.333555 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1a219b00-17ee-4f3c-a4e6-72fa5290fb7b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28397 microversion: 2.20 time: 0.318669 Sep 22 13:12:31.335958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 155/295] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:31 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:31.341361 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:31.345174 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:31.358342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.361173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.361777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1ed1dc87-d8ea-4335-901c-0c7fa915ef52 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 27825 microversion: 2.1 time: 0.385847 Sep 22 13:12:31.362578 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 141/296] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:30 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 27825 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:31.363811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.371943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.459370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:31.460109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:31.473879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.475707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.477716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.480979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.627307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:31.648578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dd29b9b1-8acd-48f2-ae77-750f9d6371c7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.310658 Sep 22 13:12:31.650370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 156/297] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:31 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:31.722096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-dec646b8-364f-48b1-b872-5cf38f6b844f req-1702a80c-62d5-4bbc-bcbb-fc2233aaebac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc54643-cc02-4783-b19d-488a79688fba", "name": "network-vif-plugged", "status": "completed", "tag": "61212e42-5473-4004-80a0-373d6f55f8f2"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:31.727957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:31.727957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:12:31.746819 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-dec646b8-364f-48b1-b872-5cf38f6b844f req-1702a80c-62d5-4bbc-bcbb-fc2233aaebac service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.747379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-dec646b8-364f-48b1-b872-5cf38f6b844f req-1702a80c-62d5-4bbc-bcbb-fc2233aaebac service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.763069 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-dec646b8-364f-48b1-b872-5cf38f6b844f req-1702a80c-62d5-4bbc-bcbb-fc2233aaebac service nova] Creating event network-vif-plugged:61212e42-5473-4004-80a0-373d6f55f8f2 for instance 1dc54643-cc02-4783-b19d-488a79688fba on hv-cinder-81000 Sep 22 13:12:31.770178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-dec646b8-364f-48b1-b872-5cf38f6b844f req-1702a80c-62d5-4bbc-bcbb-fc2233aaebac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054234 Sep 22 13:12:31.772173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 157/298] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:31.931277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:31.941070 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-aa8461a6-deda-4489-b2e6-9cf1c63952ca req-b652492a-505d-4a86-af6d-f36646a2b6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53e9d02-04e9-43e6-9f98-9f19e9598c22", "tag": "eb41f873-3231-4a5d-bb95-72494404f065"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:31.942738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:31.942738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:12:31.942900 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-019d3d4f-304e-437f-9ec2-042f35a95178 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.487384 Sep 22 13:12:31.948449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 142/299] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:31 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:31.955169 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-aa8461a6-deda-4489-b2e6-9cf1c63952ca req-b652492a-505d-4a86-af6d-f36646a2b6d9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:31.959922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-aa8461a6-deda-4489-b2e6-9cf1c63952ca req-b652492a-505d-4a86-af6d-f36646a2b6d9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:31.976849 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-aa8461a6-deda-4489-b2e6-9cf1c63952ca req-b652492a-505d-4a86-af6d-f36646a2b6d9 service nova] Creating event network-changed:eb41f873-3231-4a5d-bb95-72494404f065 for instance a53e9d02-04e9-43e6-9f98-9f19e9598c22 on hv-cinder-81000 Sep 22 13:12:31.983952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-aa8461a6-deda-4489-b2e6-9cf1c63952ca req-b652492a-505d-4a86-af6d-f36646a2b6d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047416 Sep 22 13:12:31.988584 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 158/300] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:31.989129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e5b8911-a281-4547-a3fe-ac6eed7c4526 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7185a6310>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.022615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-1e5b8911-a281-4547-a3fe-ac6eed7c4526 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] HTTP exception thrown: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. Sep 22 13:12:32.023209 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e5b8911-a281-4547-a3fe-ac6eed7c4526 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Returning 404 to user: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:32.024077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1e5b8911-a281-4547-a3fe-ac6eed7c4526 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 404 len: 109 microversion: 2.1 time: 0.043635 Sep 22 13:12:32.024622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 143/301] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:12:31 2021] GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:12:32.028983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.030325 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:32.038882 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88cd874c-9608-4af2-be23-d18fca8dfd3d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa718439af0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.039715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.040446 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.041578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.042173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.081593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-88cd874c-9608-4af2-be23-d18fca8dfd3d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] HTTP exception thrown: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. Sep 22 13:12:32.082182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88cd874c-9608-4af2-be23-d18fca8dfd3d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Returning 404 to user: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:32.083118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88cd874c-9608-4af2-be23-d18fca8dfd3d tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 404 len: 109 microversion: 2.1 time: 0.048205 Sep 22 13:12:32.083696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 144/302] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:12:32 2021] DELETE /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:12:32.091276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-da194df7-b4cd-48bf-94d7-8d95b0624033 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Calling method '.version_select at 0x7fa7184c1700>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.136759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-da194df7-b4cd-48bf-94d7-8d95b0624033 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] HTTP exception thrown: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. Sep 22 13:12:32.137789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-da194df7-b4cd-48bf-94d7-8d95b0624033 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] Returning 404 to user: Volume 7006b019-5d50-43d3-b23f-e91b7a67aca1 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:32.149059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-da194df7-b4cd-48bf-94d7-8d95b0624033 tempest-VolumesSnapshotsTestJSON-2091095939 tempest-VolumesSnapshotsTestJSON-2091095939-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1" status: 404 len: 109 microversion: 2.1 time: 0.051069 Sep 22 13:12:32.149059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 145/303] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:12:32 2021] GET /compute/v2.1/os-volumes/7006b019-5d50-43d3-b23f-e91b7a67aca1 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:12:32.348502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:32.350230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:32.358916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.364858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.366228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.373268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.440092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:32.455689 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-02674023-8fd8-4342-a21d-733fbaf2a54c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1520 microversion: 2.1 time: 0.431499 Sep 22 13:12:32.458915 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 159/304] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:32 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:32.471949 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:32.473117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:32.489725 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.492028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.493505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c2b41a79-fb3d-4579-9fde-2452b30072eb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28561 microversion: 2.20 time: 0.150025 Sep 22 13:12:32.500815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 146/305] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:32 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:32.501806 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.502568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.625878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-987472af-e289-483b-a755-40e39bf2593e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28189 microversion: 2.1 time: 0.164182 Sep 22 13:12:32.627241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 160/306] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:32 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28189 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:32.668805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.669630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:32.678468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.679063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.679970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.680628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.960582 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:32.961500 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:32.972856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.977122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:32.982843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:32.982843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.071388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:33.080909 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ba26bf9f-e852-4054-9079-8ed6c44a01d7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.417765 Sep 22 13:12:33.090277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 147/307] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:32 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:33.395525 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:33.403366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3943ad27-6080-41c9-908a-2f8e8f5c440d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1318 microversion: 2.1 time: 0.447019 Sep 22 13:12:33.403896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 161/308] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:32 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:33.475104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:33.475731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:33.481576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.482026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.482867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.483489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.508739 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:33.509842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:33.524052 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.524916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.525245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.525903 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.640276 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-063c7e9a-068b-4c4e-a30c-9cb4267e4912 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.135174 Sep 22 13:12:33.641289 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 162/309] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:33 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:33.654877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:33.654877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:33.662302 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.662853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.663772 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.664418 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.716331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:33.727688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bb315ca1-bc9b-45ec-9621-c5bed1244f49 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1500 microversion: 2.1 time: 0.256120 Sep 22 13:12:33.728550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 148/310] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:33 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1500 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:33.745316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:33.745924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:33.752157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.752878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.753857 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:33.754287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:33.755127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4f53da7c-7520-4321-9337-7d9bc64517d1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28189 microversion: 2.1 time: 0.111846 Sep 22 13:12:33.756509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 163/311] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:33 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28189 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:33.934829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:33.946457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d4a6619e-1088-4caf-b437-ac96cc240e55 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1515 microversion: 2.1 time: 0.204960 Sep 22 13:12:33.947652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 149/312] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:33 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:34.098044 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:34.098740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:34.107224 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.107930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.108878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.110234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.299637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:34.307629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-eb772812-18ad-4781-b9a4-33da3e3668ea tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.213829 Sep 22 13:12:34.308245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 164/313] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:34 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:34.420147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:34.422388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:34.428811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.429276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.431471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.431471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.654395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:34.656916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:34.667954 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.668659 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.669857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.670471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.679271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:34.688702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8540c2d4-fef2-4cd4-bd22-9084858c2ce9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1508 microversion: 2.1 time: 0.272112 Sep 22 13:12:34.689434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 150/314] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:34 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:34.775362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:34.776540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:34.787152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-11e4e14e-ad17-4f9e-90a0-279597fb161b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.136640 Sep 22 13:12:34.791742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 165/315] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:34 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:34.794817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.795671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.796961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:34.797887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:34.899699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e8f3b8a5-4bca-4498-a463-6c19d1be3bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28189 microversion: 2.1 time: 0.128542 Sep 22 13:12:34.900660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 151/316] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:34 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28189 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:35.347742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:35.354842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:35.382674 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.385866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:35.388276 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.389264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:35.623348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:35.631513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0ca22a74-9e8f-4581-9387-173d8405e3a7 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.310079 Sep 22 13:12:35.632484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 166/317] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:35 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:35.800384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:35.801704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:35.811731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.813173 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:35.814364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.815040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:35.908137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7db017d-9b99-4f7d-ade9-571d548187e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.107540 Sep 22 13:12:35.909998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 152/318] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:35 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:35.915976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:35.917829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:35.924916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.925664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:35.926447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:35.927338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.025817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f63f68d4-8ef2-4226-80ee-655e1bd6795a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28480 microversion: 2.1 time: 0.117486 Sep 22 13:12:36.030747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 167/319] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:35 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28480 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:36.089846 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:36.096201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:36.097799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.098130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.099102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.099859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.131709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lazy-loading 'flavor' on Instance uuid 62dd1478-ba12-4a46-8c78-62519c2c512b {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:36.569175 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbcc9fff-5925-4360-a871-f2e4af57fd74"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:36.570318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:36.570895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8a9bdac9-ba5f-45c4-b176-e4d068a14452 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action" status: 200 len: 32 microversion: 2.1 time: 0.485566 Sep 22 13:12:36.571722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 153/320] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:36 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:36.579067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.579798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.583869 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.583869 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.605829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:36.605829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:36.614221 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.614827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.615688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.616123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.889457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:36.900324 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8ea56d12-62a3-4c1c-b3fc-ca1bb564994f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.304171 Sep 22 13:12:36.902981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 154/321] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:36 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:36.917404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:36.918345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:36.941819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.942513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:36.943576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:36.944237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.104886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:37.115374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-55b6e6e3-515a-4914-94a1-e9e907ed7b1e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.209677 Sep 22 13:12:37.116661 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 155/322] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:36 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:37.121971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:37.123237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:37.131601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.132800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.134101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.134877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.224978 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-054874bc-4bf5-4c68-abca-8ebe80b04900 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.106862 Sep 22 13:12:37.226141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 156/323] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:37 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:37.237945 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:37.239594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:37.250457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.251230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.252262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.252887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.359180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fe03b981-d342-45d0-bc26-42955ca953bc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28576 microversion: 2.1 time: 0.126723 Sep 22 13:12:37.361605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 157/324] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:37 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28576 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:37.741241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bf2e8711-b083-451a-b48b-2d904a775e72 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.173845 Sep 22 13:12:37.741241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 168/325] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:12:36 2021] POST /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:37.925907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:37.927223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:37.938085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.939467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:37.940282 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:37.941023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.136571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:38.137294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:38.150021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.155141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:38.156665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.157736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.158352 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.166399 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8913e6c7-ef8f-4c29-9ede-e017f5e605c6 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.247824 Sep 22 13:12:38.167467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 158/326] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:37 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:38.239136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:38.239506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:38.249360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.252528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.258784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.258784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.355716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5ee6bde3-cfc2-4f1b-9e5c-60e078c9ae5e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.117821 Sep 22 13:12:38.361033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 159/327] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:38 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:38.375642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:38.377532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:38.389649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.393505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.394350 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:38.394813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:38.462173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:38.471926 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8d1455f1-2f05-45eb-ba1f-2428d9c1c4d3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.341092 Sep 22 13:12:38.472516 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 169/328] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:38 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:38.541401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c6433f0b-dd4b-4243-a8ff-9f53e54d6130 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.170284 Sep 22 13:12:38.545621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 160/329] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:38 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:39.184394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:39.185676 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:39.193398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.194083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.195118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.195739 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.370184 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:39.371379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:39.378530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.379533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.380473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.380914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.444537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:39.452899 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1bf7256d-0e97-4be4-be5b-104b97421e78 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.271929 Sep 22 13:12:39.462646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 170/330] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:39 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:39.477811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4778e609-0045-49fe-be80-9991dd2cd59d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.111158 Sep 22 13:12:39.478661 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 161/331] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:39 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:39.490154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:39.490786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:39.496629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.497077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.497850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.498291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.555766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:39.557350 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:39.565557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.565991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.566766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:39.567193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:39.644889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-008187eb-2535-4ef5-ba99-a9539647f025 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.094472 Sep 22 13:12:39.645696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 162/332] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:39 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:39.749964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:39.758431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-00439622-a29d-4cc8-b739-2611bbe296e8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.272176 Sep 22 13:12:39.759013 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 171/333] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:39 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:40.471846 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:40.472537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:40.479106 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.479582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.480412 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.480843 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.491341 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:40.493279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:40.500367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.501193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.502473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.503044 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.579896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-36b4d97a-0409-4b92-8a9d-c3d303b4c959 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 28729 microversion: 2.20 time: 0.092153 Sep 22 13:12:40.594880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 172/334] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:40 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 28729 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:40.658140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:40.658763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:40.659212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:40.667180 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.667534 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-251fc814-350e-4c63-9fd2-ac4a18395fdc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.200913 Sep 22 13:12:40.667653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.668677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 163/335] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:40 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:40.668788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.674648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.742339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e3d6bf5d-5493-4b69-b06d-96cab446b8c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.088689 Sep 22 13:12:40.743342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 173/336] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:40 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:40.776473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:40.777370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:40.784370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.784820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.785855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:40.786293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:40.996166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:41.004972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6fdcca35-4caa-48bf-a433-207de88cb0a8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.232582 Sep 22 13:12:41.005562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 164/337] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:40 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:41.606336 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:41.607345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:41.615359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.616146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.620868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.620868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.657449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-5c394abc-734a-4217-8e3e-5b1bbebe8a49 req-071b7342-6c80-4124-b040-cf8951bf8036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53e9d02-04e9-43e6-9f98-9f19e9598c22", "name": "network-vif-plugged", "status": "completed", "tag": "eb41f873-3231-4a5d-bb95-72494404f065"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:41.659144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:41.659144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:12:41.670190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-5c394abc-734a-4217-8e3e-5b1bbebe8a49 req-071b7342-6c80-4124-b040-cf8951bf8036 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.670190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-5c394abc-734a-4217-8e3e-5b1bbebe8a49 req-071b7342-6c80-4124-b040-cf8951bf8036 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.684811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-5c394abc-734a-4217-8e3e-5b1bbebe8a49 req-071b7342-6c80-4124-b040-cf8951bf8036 service nova] Creating event network-vif-plugged:eb41f873-3231-4a5d-bb95-72494404f065 for instance a53e9d02-04e9-43e6-9f98-9f19e9598c22 on hv-cinder-81000 Sep 22 13:12:41.691008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-5c394abc-734a-4217-8e3e-5b1bbebe8a49 req-071b7342-6c80-4124-b040-cf8951bf8036 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037434 Sep 22 13:12:41.691676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 165/338] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:41.697683 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:41.698546 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:41.705896 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.706358 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.707271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.707741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.752630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8982c1f7-72e0-4e51-af73-01d80eb9a1b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 30038 microversion: 2.20 time: 0.150863 Sep 22 13:12:41.761860 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 174/339] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:41 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 30038 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:41.767752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:41.769051 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:41.780043 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.780680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.781472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:41.782065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:41.858065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a2ff21f6-3d30-466a-9b08-9be895a33bb2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.094567 Sep 22 13:12:41.860108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 175/340] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:41 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:42.005486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:42.014764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b041a4b9-c005-463a-b42f-e961a8c1f6f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.321456 Sep 22 13:12:42.023774 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:42.025079 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:42.034294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.035463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.036456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.039165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.046100 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 166/341] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:41 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:42.305626 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:42.314109 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cb6bc42d-a15e-4ca0-b091-755d7527f6c4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.295571 Sep 22 13:12:42.314704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 176/342] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:42 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:42.769856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:42.770869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:42.777038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.777488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.778285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.778714 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.873514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:42.874691 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:42.884462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7bab691f-b996-477d-9860-28fe0c9c9b05 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 31296 microversion: 2.20 time: 0.118454 Sep 22 13:12:42.885339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 167/343] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:42 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 31296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:42.886582 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.887030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.887853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:42.888311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:42.982143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0f3276ca-5349-4a86-acc6-ed25728949ab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.108031 Sep 22 13:12:42.982143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 177/344] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:42 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:43.034703 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:43.035913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:43.042406 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.042848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.043642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.044069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.173318 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:43.181041 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-89c132a6-94d4-4466-bce2-88bbb725ee45 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.151011 Sep 22 13:12:43.181629 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 168/345] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:43 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:43.332565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:43.333654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:43.340965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.341783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.343392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.344087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.531688 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:43.542944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ef5bb414-09fd-420c-aee8-b4e91bbbbfa8 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1313 microversion: 2.1 time: 0.214611 Sep 22 13:12:43.551526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 178/346] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:43 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:43.953526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:43.953526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:43.953526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.953526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.954241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.954241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:43.989333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:43.990980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:43.998126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:43.998984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.000483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:44.001082 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.043968 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd22f103-cebc-4410-8de3-a33594016610 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 32354 microversion: 2.20 time: 0.150730 Sep 22 13:12:44.044932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 169/347] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:43 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 32354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:44.091537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1a739cf8-9216-460a-b45f-5486555bb136 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28648 microversion: 2.1 time: 0.105527 Sep 22 13:12:44.095724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 179/348] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:43 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28648 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:44.207506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:44.208567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:44.222187 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:44.222869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.223811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:44.224266 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.381518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:44.391947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d823b30e-5aa9-44eb-a38a-05e9384162db tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.189743 Sep 22 13:12:44.401214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 170/349] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:44 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:44.569480 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:44.570122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:44.584300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:44.584300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.584300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:44.584300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:44.848473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:44.857422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e1d2cc81-ec3b-477b-96ee-b8db52b7b26b tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1496 microversion: 2.1 time: 0.294648 Sep 22 13:12:44.858952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 180/350] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:44 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1496 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:45.056782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:45.057609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:45.072692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.073157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.073939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.074369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.113251 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:45.115351 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:45.128695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.129440 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.130420 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.135204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.204756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8c2c96ab-e441-4628-b406-e21c530c78da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 33040 microversion: 2.20 time: 0.151375 Sep 22 13:12:45.207022 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 171/351] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:45 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 33040 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:45.248061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6c2d209d-80b1-42f6-8c7d-0adf6e97f851 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 28785 microversion: 2.1 time: 0.144231 Sep 22 13:12:45.250452 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 181/352] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:45 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 28785 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:45.409501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:45.410464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:45.418029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.419902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.420538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:45.421331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:45.693693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:45.708242 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-95674358-78ac-42ca-a0c0-6dd5b1f91191 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.303335 Sep 22 13:12:45.720903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 172/353] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:45 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:46.226324 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:46.226324 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.227615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:46.227615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.242352 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.243407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.244051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.245143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.245695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.246631 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.247046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.251246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.301074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:12:46.382518 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f5862704-2b3d-44c4-9473-421f484856b2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 33476 microversion: 2.20 time: 0.169019 Sep 22 13:12:46.384451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 173/354] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:46 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 33476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:46.390658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:46.392141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.403690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.404119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.405220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.405662 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.544671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1c0232cb-7884-4574-922b-e0b19b4114d6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 30154 microversion: 2.1 time: 0.158215 Sep 22 13:12:46.545052 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 174/355] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:46 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 30154 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:46.558585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbcc9fff-5925-4360-a871-f2e4af57fd74"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:46.558585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.570847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.571307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.572136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.572577 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.714286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Invalid volume: volume dbcc9fff-5925-4360-a871-f2e4af57fd74 is already attached to instances: 1dc54643-cc02-4783-b19d-488a79688fba Sep 22 13:12:46.714892 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 400 to user: Invalid volume: volume dbcc9fff-5925-4360-a871-f2e4af57fd74 is already attached to instances: 1dc54643-cc02-4783-b19d-488a79688fba {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:46.721245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-202ffae1-f9d4-4eb8-9deb-54502eb2fb44 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163864 Sep 22 13:12:46.721245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 175/356] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:12:46 2021] POST /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments => generated 174 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 22 13:12:46.730680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:46.731599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.742119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.754488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.758670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.758670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.910665 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:46.920132 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-893dc0f5-0ba6-4933-ae01-c8b8fe19d624 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.194188 Sep 22 13:12:46.923844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 176/357] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:46 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:46.929563 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:46.933037 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:46.942017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.953228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:46.958571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:46.959057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.063008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9ba05b46-fa86-4cff-ab55-a2d4d7a6bffb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 204 len: 0 microversion: 2.1 time: 0.851441 Sep 22 13:12:47.064965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 182/358] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:12:46 2021] DELETE /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:12:47.083853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:47.083853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:47.085026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.085544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.086414 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.087137 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.127170 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'services' on Instance uuid 1dc54643-cc02-4783-b19d-488a79688fba {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:47.292296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:47.306351 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7d199f30-3d91-4bfc-8b95-c28f4b9d1552 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1502 microversion: 2.1 time: 0.234741 Sep 22 13:12:47.320223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 183/359] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:47 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:47.399125 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:47.400478 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:47.408474 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.412752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.412752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.412752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.418449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9e549d0f-0ac7-44bf-ab71-a9f8440b0a5b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments/dbcc9fff-5925-4360-a871-f2e4af57fd74" status: 202 len: 0 microversion: 2.1 time: 0.490645 Sep 22 13:12:47.418449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 177/360] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:12:46 2021] DELETE /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments/dbcc9fff-5925-4360-a871-f2e4af57fd74 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:47.434000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:47.435306 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:47.445675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.446108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.447080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.447387 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.485084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a8d749bd-d478-4add-81fd-c4077b4ebfd7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061108 Sep 22 13:12:47.486127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 178/361] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:47 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:47.534349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6d2ea264-0ce4-4163-ae8e-43b4e659475e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 33988 microversion: 2.20 time: 0.141719 Sep 22 13:12:47.537289 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 184/362] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:47 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 33988 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:47.559229 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:47.560302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:47.571560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.572064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.572854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.573281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.677798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0a9c70ea-6fb8-44ff-81c1-f6bf1546a0f9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 31439 microversion: 2.1 time: 0.123118 Sep 22 13:12:47.678489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 179/363] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:47 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 31439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:47.939086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:47.939893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:47.948946 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.949861 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:47.954680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:47.955514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.134407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:48.146426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-13a875cc-e5d6-465b-8271-c5a2c2edddee tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.212281 Sep 22 13:12:48.147740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 185/364] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:47 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:48.328002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:48.328850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:48.340995 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.341441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.342230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.343262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.497144 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:48.499786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:48.510352 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.511219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.513310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:48.515685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.516405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.523442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-de65d696-ea6d-4243-b713-7a27ac7177ae tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1502 microversion: 2.1 time: 0.199943 Sep 22 13:12:48.525305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 180/365] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:48 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:48.566650 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:48.569299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:48.571608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d4e194b1-4b1d-4e1a-998f-c7f2546d379e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078188 Sep 22 13:12:48.572453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 186/366] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:48 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:48.579891 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.580338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.581248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.581815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.705977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:48.705977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:48.707457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-57efcbd2-14fd-4dc3-819e-c4d892c21edd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 34555 microversion: 2.20 time: 0.155332 Sep 22 13:12:48.709947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 181/367] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:48 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 34555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:48.725088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.725737 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.732018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:48.735712 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:48.840836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7e88e2b9-e467-4f56-af6d-639169072eee tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 32398 microversion: 2.1 time: 0.149047 Sep 22 13:12:48.841965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 187/368] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:48 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 32398 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:49.165145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:49.166114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:49.178411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.178862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.179737 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.180393 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.351142 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:49.359148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-58d636b6-4cb6-45ea-ba61-62ed05dcf870 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.198184 Sep 22 13:12:49.372211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 182/369] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:49 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:49.542526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:49.548847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:49.552320 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.552975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.553923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.554348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.584296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:49.585211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:49.593392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.594580 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.603724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.604438 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.648167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b886311d-ff55-4675-884f-6046f2e21068 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067527 Sep 22 13:12:49.655825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 183/370] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:12:49 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:12:49.718988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:49.720171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:49.740323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.740928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.757194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.757194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.844555 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:49.852523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f4b34c32-56bf-432a-be33-642c86558b86 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 35332 microversion: 2.20 time: 0.137146 Sep 22 13:12:49.853805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 184/371] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:49 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 35332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:49.859574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:49.865746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2a000203-bf9b-48a0-93ac-0be10fe8556f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1502 microversion: 2.1 time: 0.327295 Sep 22 13:12:49.874674 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 188/372] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:49 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1502 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:49.884164 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:49.895806 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.896258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.897063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:49.897537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:49.908716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-550214770", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "486be222-2dae-4806-b5f2-6aa278197135"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:49.978615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] validate_networks() for [('486be222-2dae-4806-b5f2-6aa278197135', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:12:49.984444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f7486e10-0eae-4d15-be38-d63696272683 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 33126 microversion: 2.1 time: 0.129062 Sep 22 13:12:49.988453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 185/373] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:49 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 33126 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:50.276378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-ea9197d0-1928-4fde-ad3b-b9de09c8a0d2 req-cf38eb1b-1aae-4c0c-898b-8090bbb52f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53e9d02-04e9-43e6-9f98-9f19e9598c22", "name": "network-vif-deleted", "tag": "eb41f873-3231-4a5d-bb95-72494404f065"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:50.278089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:50.278089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:12:50.291636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ea9197d0-1928-4fde-ad3b-b9de09c8a0d2 req-cf38eb1b-1aae-4c0c-898b-8090bbb52f19 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.291636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ea9197d0-1928-4fde-ad3b-b9de09c8a0d2 req-cf38eb1b-1aae-4c0c-898b-8090bbb52f19 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.300814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-ea9197d0-1928-4fde-ad3b-b9de09c8a0d2 req-cf38eb1b-1aae-4c0c-898b-8090bbb52f19 service nova] Creating event network-vif-deleted:eb41f873-3231-4a5d-bb95-72494404f065 for instance a53e9d02-04e9-43e6-9f98-9f19e9598c22 on hv-cinder-81000 Sep 22 13:12:50.306042 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-ea9197d0-1928-4fde-ad3b-b9de09c8a0d2 req-cf38eb1b-1aae-4c0c-898b-8090bbb52f19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Sep 22 13:12:50.306904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 186/374] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:12:50.391539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:50.392193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:50.399084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.399792 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.400565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.400992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.543651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:50.554328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1547846f-fb2a-4052-a007-6cfdbc9be6ea tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.167405 Sep 22 13:12:50.554691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 187/375] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:50 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:50.761234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:12:50.761761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:12:50.762141 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:12:50.762545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:12:50.762950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:12:50.773879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.774348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.775151 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.775621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.792836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:50.796725 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Getting quotas for user 028372696b274b29b940bf5a602c4471 and project 86bd01d73b164c0496803e15f5becaea. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:50.807799 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:12:50.810095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:12:50.865045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:50.865965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:50.874763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.875210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.876050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:50.876488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:50.962592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b483c7b2-cd40-412c-925b-54d7fb0e7bc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 36284 microversion: 2.20 time: 0.101126 Sep 22 13:12:50.966856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 188/376] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:50 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 36284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:50.975397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cedb6b9c-fbd0-404e-817c-0bedc327e74b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095249 Sep 22 13:12:50.976405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 189/377] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:12:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:12:50.989765 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-862185fe-0f36-4a0a-a869-5c8d581d3cb6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:50.992848 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-862185fe-0f36-4a0a-a869-5c8d581d3cb6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:51.004209 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:51.010380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:51.019237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.020041 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.021395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.022135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.098617 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-862185fe-0f36-4a0a-a869-5c8d581d3cb6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:51.107355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-862185fe-0f36-4a0a-a869-5c8d581d3cb6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1217 microversion: 2.1 time: 0.121270 Sep 22 13:12:51.113501 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 190/378] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:50 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1217 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:51.123497 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:51.123783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:51.132273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:51.141290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cddded30-d141-4c2f-87b6-6c311aa0446e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1298 microversion: 2.1 time: 0.176122 Sep 22 13:12:51.141871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 189/379] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:50 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:51.150090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.150742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.153852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.153852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.266870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-45647874-99a7-4c2e-b895-bec241af9a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 33707 microversion: 2.1 time: 0.152646 Sep 22 13:12:51.267959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 191/380] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:51 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 33707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:51.573171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:51.573786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:51.592549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.593335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.594301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.594721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.782626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:51.793407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7220a05-0c67-4a73-acd2-5cf58870ddd7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.223794 Sep 22 13:12:51.794002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 190/381] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:51 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:51.978462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:51.979477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:51.987715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.988153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:51.989026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:51.989363 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.103381 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2887a6e0-f399-4d32-b936-5c4e17ed886e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 37100 microversion: 2.20 time: 0.125905 Sep 22 13:12:52.104989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 192/382] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:51 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 37100 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:52.130525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-112c352c-8498-4089-afc5-1e3cca1c8f75 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:52.132011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-112c352c-8498-4089-afc5-1e3cca1c8f75 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:52.160092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:52.161108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:52.173080 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.173964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.175118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.175780 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.196709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-112c352c-8498-4089-afc5-1e3cca1c8f75 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:52.206631 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-112c352c-8498-4089-afc5-1e3cca1c8f75 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1217 microversion: 2.1 time: 0.079992 Sep 22 13:12:52.207876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 191/383] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:52 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:52.225159 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.225740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.226283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lazy-loading 'fault' on Instance uuid a53e9d02-04e9-43e6-9f98-9f19e9598c22 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:12:52.280976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:52.284108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:52.295869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:52.296028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0976b74d-b551-4063-91a8-ac06c4a8cd7a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 200 len: 1303 microversion: 2.1 time: 0.138725 Sep 22 13:12:52.296028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 193/384] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:52 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:52.300599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.301305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.302110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.302577 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.395675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88d7d374-6295-43a7-86cf-53431b9922c5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 34211 microversion: 2.1 time: 0.119202 Sep 22 13:12:52.396914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 192/385] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:52 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 34211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:52.811301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:52.812648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:52.824341 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.824784 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:52.830294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:52.830732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.038746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:53.048114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-aec5e6f9-4f3d-4ebb-b5e8-585cecce4bb3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.241733 Sep 22 13:12:53.049484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 194/386] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:52 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:53.121193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:53.123228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:53.132166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.135070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.135861 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.136318 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.224620 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:53.225745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:53.233188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.234063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.235328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.235881 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.245993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1f7cde20-6345-4469-aeb7-0fe9e01dac0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 38071 microversion: 2.20 time: 0.130228 Sep 22 13:12:53.246646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 193/387] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:53 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 38071 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:12:53.313024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:53.314282 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: a53e9d02-04e9-43e6-9f98-9f19e9598c22] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:53.323596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:53.335401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.337705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2cdd81d1-8eb1-44e5-b6be-b6e36e262052 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1269 microversion: 2.1 time: 0.116757 Sep 22 13:12:53.338602 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 195/388] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:53 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:53.339378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.340715 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.341626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.364780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] HTTP exception thrown: Instance a53e9d02-04e9-43e6-9f98-9f19e9598c22 could not be found. Sep 22 13:12:53.365421 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Returning 404 to user: Instance a53e9d02-04e9-43e6-9f98-9f19e9598c22 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:12:53.366301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-37b53fc0-0125-4854-947a-563672e0c571 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22" status: 404 len: 111 microversion: 2.1 time: 0.059597 Sep 22 13:12:53.367020 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 194/389] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:53 2021] GET /compute/v2.1/servers/a53e9d02-04e9-43e6-9f98-9f19e9598c22 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:12:53.410594 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:53.412091 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:53.424166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.424631 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.425591 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:53.426026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:53.525040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1302076983", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "d0a1aecb-1239-48e9-9116-fc0789f6366d"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:53.556664 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-eaa8c3e2-e06b-46c9-9047-cde0d4ca7842 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 34906 microversion: 2.1 time: 0.150519 Sep 22 13:12:53.557793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 196/390] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:53 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 34906 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:53.619307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] validate_networks() for [('d0a1aecb-1239-48e9-9116-fc0789f6366d', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:12:54.066724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:54.068459 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:54.078006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.078550 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.079421 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.079952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.238847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:54.247512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cc916c2a-6904-4a99-b9b1-57c242ebb65c tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.184974 Sep 22 13:12:54.248410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 197/391] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:54 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:54.263254 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:54.264983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:54.272520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.272989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.274003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.274533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.372558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1434cc02-348d-472f-aa3d-d110a7718027 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 38249 microversion: 2.20 time: 0.112408 Sep 22 13:12:54.377380 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 198/392] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:54 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 38249 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:54.377705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:12:54.378193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:12:54.378580 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:12:54.379051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:12:54.379559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:12:54.380960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:54.381704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:54.389312 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.389992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.390782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.390990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.391162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.391459 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.392243 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.392676 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.409283 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Getting quotas for project dc99723145834860a6127632c31447c4. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:54.414054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Getting quotas for user b5b51719cefc4d2d94d766b18ffab5fb and project dc99723145834860a6127632c31447c4. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:54.425297 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:12:54.427719 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:12:54.461382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:54.469458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e5645598-56bd-4496-aa8a-f33477ee945c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1269 microversion: 2.1 time: 0.093391 Sep 22 13:12:54.470033 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 199/393] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:54 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:54.568519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:54.569455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:54.575388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.575875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.577207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:54.577633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:54.663833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-55b2e147-8055-48e9-aa3d-94c998d80cc1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 35503 microversion: 2.1 time: 0.098895 Sep 22 13:12:54.666426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 200/394] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:54 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 35503 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:55.127778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5a3a2574-225f-4a3c-89d8-8104aef6571d tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606373 Sep 22 13:12:55.139496 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5a280edd-c1a0-4929-9328-76192853e40f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:55.144976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5a280edd-c1a0-4929-9328-76192853e40f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:55.145597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 195/395] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:12:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 13:12:55.265851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:55.266104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:55.273599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.274051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.274826 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.275252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.298638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5a280edd-c1a0-4929-9328-76192853e40f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:55.307709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5a280edd-c1a0-4929-9328-76192853e40f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1214 microversion: 2.1 time: 0.172495 Sep 22 13:12:55.308505 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 201/396] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:55 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:55.385176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:55.386084 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:55.397789 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.403605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.404917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.405507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.429619 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:55.440008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9c03defb-35c5-44ce-9646-3caedf22b2a1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.177705 Sep 22 13:12:55.440946 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 196/397] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:55 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:55.487114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:55.490183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:55.497968 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.498779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.500330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.500330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.507750 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3a37ef2d-8b13-4631-b7f3-1eb70c35a2a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 38253 microversion: 2.20 time: 0.125963 Sep 22 13:12:55.508507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 202/398] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:55 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 38253 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:55.594268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:55.606920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-300243ae-7580-4d1e-b72b-6e0484cb89b0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1287 microversion: 2.1 time: 0.121863 Sep 22 13:12:55.606920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 197/399] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:55 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:55.677050 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:55.678040 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:55.685066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.686066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.686802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:55.687315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:55.765307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d862119f-fa50-4ef7-90fb-54c130d21ba2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 36518 microversion: 2.1 time: 0.092278 Sep 22 13:12:55.766938 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 203/400] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:55 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 36518 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:56.306648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'create', calling method: .version_select at 0x7fa7185a6310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1740085743"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:56.325744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for project 71b37942aed94a0193ab222fd05836ab. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:56.325945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:56.327048 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.330711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for user 280f27d698654a4f93ef361dd022de19 and project 71b37942aed94a0193ab222fd05836ab. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:56.335854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.336287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.341791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.341897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.432745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:56.441333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0d62e7b9-90cd-4112-aa95-395b7ac8892f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1218 microversion: 2.1 time: 0.119766 Sep 22 13:12:56.442944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 204/401] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:56 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:56.457458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:56.458056 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.463884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.464324 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.465115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.465515 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.559842 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for project 71b37942aed94a0193ab222fd05836ab. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:56.565729 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for user 280f27d698654a4f93ef361dd022de19 and project 71b37942aed94a0193ab222fd05836ab. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:56.580394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-48862a31-2733-4339-9276-b39de3b17c24 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.277195 Sep 22 13:12:56.580921 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 198/402] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Sep 22 13:12:56 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:56.597579 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:56.603308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.604960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.605479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.606343 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.606847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.690068 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9899f7e5-bd62-4953-a936-be9e4c92a545 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 200 len: 38392 microversion: 2.20 time: 0.096138 Sep 22 13:12:56.691728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 199/403] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:12:56 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 38392 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:12:56.697251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:56.698378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.708698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:56.710050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.710514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.711397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.716338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.718474 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-076aea80-dc8f-4acc-902d-27d4e8afd5f2 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.263426 Sep 22 13:12:56.719263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 205/404] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:56 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:56.724153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1548109015", "imageRef": "5b743b65-c80e-4c47-9776-e070c7e9f5f4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1740085743", "networks": [{"uuid": "a359761d-81d8-40c4-999e-73f019d63b70"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:56.819410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] validate_networks() for [('a359761d-81d8-40c4-999e-73f019d63b70', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:12:56.876157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:56.884086 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-204064c8-54e3-46f2-ac66-083d5b950d43 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.191436 Sep 22 13:12:56.889600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 200/405] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:56 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:56.889803 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:56.890148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.896281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.896749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.897511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.897937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.924269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c4f8362f-c4e4-44d8-b8fc-c3da99699c84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/ips" status: 200 len: 151 microversion: 2.20 time: 0.038560 Sep 22 13:12:56.925344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 201/406] 10.222.0.43 () {60 vars in 1289 bytes} [Wed Sep 22 13:12:56 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:56.929820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:56.930845 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:56.937289 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.937842 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:56.938738 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:56.939592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.044913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c3517458-9357-4482-91a3-ea27992385c0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 37674 microversion: 2.1 time: 0.117987 Sep 22 13:12:57.045813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 202/407] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:56 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 37674 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:57.394739 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:12:57.395237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:12:57.395690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:12:57.396092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:12:57.396552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:12:57.405732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.406169 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.406959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.407383 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.423936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for project 71b37942aed94a0193ab222fd05836ab. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:12:57.430785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Getting quotas for user 280f27d698654a4f93ef361dd022de19 and project 71b37942aed94a0193ab222fd05836ab. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:12:57.441826 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:12:57.444269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b743b65-c80e-4c47-9776-e070c7e9f5f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:12:57.462395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:57.463091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:57.480319 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.481025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.481976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.482846 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.549651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:57.561729 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fb65ab90-850f-4d02-afde-88450fb70c31 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1266 microversion: 2.1 time: 0.106107 Sep 22 13:12:57.562985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 203/408] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:57 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:57.571958 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-a0b9cf8b-1a32-4a3a-8698-7266ee3edc7d req-03e98409-1665-4569-8543-5f6dec223205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c9c788-beff-4411-a824-3363acb27590", "tag": "f332588d-756b-4e7c-abe2-71a2c5b790a6"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:57.575189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:12:57.575189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:12:57.586539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a0b9cf8b-1a32-4a3a-8698-7266ee3edc7d req-03e98409-1665-4569-8543-5f6dec223205 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.592775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a0b9cf8b-1a32-4a3a-8698-7266ee3edc7d req-03e98409-1665-4569-8543-5f6dec223205 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.594384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-75b9dd8e-9cfb-4ead-a385-8149ccef1ef7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873736 Sep 22 13:12:57.595495 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 206/409] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:12:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:12:57.603123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-a0b9cf8b-1a32-4a3a-8698-7266ee3edc7d req-03e98409-1665-4569-8543-5f6dec223205 service nova] Creating event network-changed:f332588d-756b-4e7c-abe2-71a2c5b790a6 for instance 44c9c788-beff-4411-a824-3363acb27590 on hv-cinder-81000 Sep 22 13:12:57.607191 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-345ceea1-faa5-4916-85ac-a9cfff3a3c36 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:57.608854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-345ceea1-faa5-4916-85ac-a9cfff3a3c36 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:57.609057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-a0b9cf8b-1a32-4a3a-8698-7266ee3edc7d req-03e98409-1665-4569-8543-5f6dec223205 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043659 Sep 22 13:12:57.609781 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 204/410] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:12:57.736230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-345ceea1-faa5-4916-85ac-a9cfff3a3c36 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:57.738539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:57.739667 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:57.746427 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-345ceea1-faa5-4916-85ac-a9cfff3a3c36 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1259 microversion: 2.1 time: 0.144313 Sep 22 13:12:57.756985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 207/411] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:57 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:57.757137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.757137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.757137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.757137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.900724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:57.901429 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:57.907014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:57.908405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.909092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.910329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:57.910913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:57.922475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5fff6803-0958-4c15-97fa-b6219fad6cb1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.182403 Sep 22 13:12:57.922475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 205/412] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:57 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:58.058027 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:58.061169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:58.068670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.069309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:58.070131 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.070540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:58.149950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0278fc5b-eed2-42ab-a1fc-04d742c4b852 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 38153 microversion: 2.1 time: 0.096168 Sep 22 13:12:58.151209 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 206/413] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:58 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 38153 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:12:58.219292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:58.226730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fd196921-410c-46ba-9e7f-7714c9f48941 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.329737 Sep 22 13:12:58.227392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 208/414] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:57 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:12:58.589102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:58.589897 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:58.597807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.598454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:58.599311 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.599846 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:58.715966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:58.717663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bafc52bd-1dde-40e1-97e1-4c660332b396 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1284 microversion: 2.1 time: 0.132795 Sep 22 13:12:58.718462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 207/415] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:58 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:58.764844 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2c16bfb8-41cc-4529-a960-984847057606 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:58.765378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2c16bfb8-41cc-4529-a960-984847057606 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:58.860174 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2c16bfb8-41cc-4529-a960-984847057606 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:58.863207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2c16bfb8-41cc-4529-a960-984847057606 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1259 microversion: 2.1 time: 0.102350 Sep 22 13:12:58.874843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 209/416] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:58 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1259 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:58.943646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:58.944511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:58.953225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.954077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:58.954941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:58.955623 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.094056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:59.101576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-39558109-b521-4289-85d8-897e78038308 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.166825 Sep 22 13:12:59.102155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 208/417] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:58 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:59.162825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:12:59.164152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:59.170561 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.171144 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.171987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.172418 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.248159 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f1dfe26e-17c7-48f2-a767-2d3e1285613c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 38153 microversion: 2.1 time: 0.089359 Sep 22 13:12:59.254415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:59.255363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:59.255660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 210/418] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:12:59 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 38153 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:12:59.272175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.273387 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.273860 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.274359 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.427489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:59.436039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-11a92823-1b27-4080-abfa-433fe552c65e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.193913 Sep 22 13:12:59.436513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 209/419] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:59 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:12:59.735827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:59.736558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:59.743132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.743621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.744437 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.744958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.881909 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:12:59.882483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:12:59.889642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.890193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.891990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:12:59.891990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:12:59.957988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:12:59.967625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bfc04c6f-204c-4ed0-94f8-2e2bdaa7b39e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1263 microversion: 2.1 time: 0.088591 Sep 22 13:12:59.969009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 210/420] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:59 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:00.004756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:00.012291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-acf89740-c492-4d0e-8a7b-53754c493d4f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.281016 Sep 22 13:13:00.012868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 211/421] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:12:59 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:00.118734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:00.119339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.125827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.126275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.127040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.127512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.167658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:00.168258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.174358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.177593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.177593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.177593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.201845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lazy-loading 'flavor' on Instance uuid a4d69add-5d3b-4453-bf51-5a27d905e4e7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:13:00.272659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:00.280640 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88672e25-0e2b-4d44-8c91-30f2c639a172 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.165544 Sep 22 13:13:00.281449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 211/422] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:00 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:00.286504 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:00.287747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.294052 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.294789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.295624 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.296063 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.383681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f0408117-5bcb-4e9c-8072-ef52a6c7548e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 38153 microversion: 2.1 time: 0.100507 Sep 22 13:13:00.384369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 212/423] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:00 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 38153 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:13:00.454147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:00.457622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.462185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.462668 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.463480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.463915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.596271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:00.603829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-944cf339-5e57-4e03-88ab-906f9d200695 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.154152 Sep 22 13:13:00.604409 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 213/424] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:00 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:00.609675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-56f7b5e3-ba61-4f6f-8f4b-dbd6d9309b14 req-3efcfa6e-98d7-4aca-b38c-4be9f390fd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e80789-599b-40eb-a28c-7bb59a54e6df", "tag": "623ab9c0-8903-4af9-8bc6-bd4560116795"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:00.611463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:00.611463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:00.618841 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-56f7b5e3-ba61-4f6f-8f4b-dbd6d9309b14 req-3efcfa6e-98d7-4aca-b38c-4be9f390fd02 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.619283 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-56f7b5e3-ba61-4f6f-8f4b-dbd6d9309b14 req-3efcfa6e-98d7-4aca-b38c-4be9f390fd02 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.630103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-56f7b5e3-ba61-4f6f-8f4b-dbd6d9309b14 req-3efcfa6e-98d7-4aca-b38c-4be9f390fd02 service nova] Creating event network-changed:623ab9c0-8903-4af9-8bc6-bd4560116795 for instance 87e80789-599b-40eb-a28c-7bb59a54e6df on hv-cinder-81000 Sep 22 13:13:00.634825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-56f7b5e3-ba61-4f6f-8f4b-dbd6d9309b14 req-3efcfa6e-98d7-4aca-b38c-4be9f390fd02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029197 Sep 22 13:13:00.635411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 214/425] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:00.942493 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2b3e8d43-7758-4bf1-baa3-4a8d50efc51e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 202 len: 0 microversion: 2.20 time: 0.778555 Sep 22 13:13:00.945451 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 212/426] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:13:00 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 13:13:00.952646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:00.953430 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.959271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.959744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.960503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.960941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.986185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:00.987136 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:00.995766 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:00.996249 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:00.997011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.001891 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.078632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.086000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9919c2db-1983-423d-9c52-ba0e97656004 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1311 microversion: 2.1 time: 0.104299 Sep 22 13:13:01.086785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 213/427] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:00 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:01.090597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.097715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:01.098319 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:01.098842 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.100375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.101878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-45fb404c-82ae-4d0c-ba2c-b0f5b5d83675 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.153956 Sep 22 13:13:01.104145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.104992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.105786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.106218 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.110635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 215/428] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:00 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:01.298919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:01.299553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:01.305663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.306099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.306897 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.307334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.311073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.319544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c54f19e1-fbdf-424f-bc45-61fab61472a4 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.225267 Sep 22 13:13:01.320426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 214/429] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:01 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:01.395956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:01.396847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:01.410200 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.410672 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.412176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.412625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.489698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.500018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb490386-990a-443e-99fb-0dc055311111 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.205164 Sep 22 13:13:01.501232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 216/430] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:01 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:01.537481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-83d97fd0-a659-40e7-8d83-8f7c754d4874 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 200 len: 38284 microversion: 2.1 time: 0.137594 Sep 22 13:13:01.537481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 215/431] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:01 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 38284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:13:01.543651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:01.544402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:01.551376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.556079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.556079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.556079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.583954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f9720511-fc61-4118-b854-5c1651f25132 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/ips" status: 200 len: 146 microversion: 2.1 time: 0.045138 Sep 22 13:13:01.590058 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 217/432] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:13:01 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:01.623879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:01.624911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:01.633793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.634430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.635219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:01.635695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:01.892316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:01.901736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-957f6ae3-5588-4317-ad2c-bd9068b037bb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.284852 Sep 22 13:13:01.902325 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 216/433] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:01 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:02.104281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:02.105269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:02.113689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.114399 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.123039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:02.124004 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:02.126905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.127672 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.132197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.132897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.133889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.134498 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.214462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.227887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-89cdbac6-294f-479c-8eb9-11977028ff98 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1317 microversion: 2.1 time: 0.127846 Sep 22 13:13:02.230757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 218/434] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:02 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1317 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:02.348696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:02.354629 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:02.363487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.364230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.365115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.365692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.375027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.387905 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.390948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.392336 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-56feccf3-d3d1-4de8-836d-795816434163 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.274240 Sep 22 13:13:02.393001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 217/435] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:02 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:02.516758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.519001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:02.519647 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:02.525721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-22debad0-3396-4710-bd11-93671cd31e9e tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.184338 Sep 22 13:13:02.526297 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 219/436] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:02 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:02.532935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.533378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.534668 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.534950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.918916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:02.923390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:02.923720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:02.940057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-79dc331e-aa30-4d2a-84e8-cfde703c3429 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1501 microversion: 2.1 time: 0.423481 Sep 22 13:13:02.947492 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.948754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 218/437] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:02 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:02.948973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.950893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:02.951808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:02.988773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1544bee2-d37b-42fd-abc8-46df5a252c6c"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:02.995591 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.008016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.008536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.009479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.009912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.071924 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] HTTP exception thrown: Cannot 'attach_volume' instance 62dd1478-ba12-4a46-8c78-62519c2c512b while it is in vm_state rescued Sep 22 13:13:03.078337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Returning 409 to user: Cannot 'attach_volume' instance 62dd1478-ba12-4a46-8c78-62519c2c512b while it is in vm_state rescued {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:13:03.078337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2dcc5119-88f1-4dbe-9a66-eb2f5fe2fbf4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114059 Sep 22 13:13:03.079277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 219/438] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:13:02 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 22 13:13:03.099182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:03.109410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.127795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.129566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.134097 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.135378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.377059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.384944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-df801320-2308-4445-8046-e0f1ce44562f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.466991 Sep 22 13:13:03.385861 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 220/439] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:02 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:03.391577 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:03.391767 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.397761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.398208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.399188 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.399667 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.533700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e42c4784-4862-412c-b994-3ac395d9c237 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action" status: 202 len: 0 microversion: 2.1 time: 0.444762 Sep 22 13:13:03.541228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 220/440] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:03 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:13:03.551566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:03.554574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.560791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.562438 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.563406 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.564227 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.630089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.639366 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9b0314df-a52d-47f8-94b3-76d8e1d601a2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.252362 Sep 22 13:13:03.640328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 221/441] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:03 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:03.648218 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:03.652039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.658679 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.659621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.660417 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.661035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.796698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.806226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.807894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.809235 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-437d05bf-0c56-400a-b168-f293e34e3c76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.266433 Sep 22 13:13:03.810166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 221/442] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:03 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:03.826951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:03.829204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:03.846215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.846826 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.856627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:03.861520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:03.863011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:03.875101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-28a9b947-2f08-4e9f-903c-69ba660f30c5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.232814 Sep 22 13:13:03.876051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 222/443] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:03 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:04.022398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:04.038274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6fb4532d-9734-497f-91fd-9538205a2faa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.224690 Sep 22 13:13:04.047127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 222/444] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:03 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:04.410290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:04.410907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:04.416689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.417133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.417895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.418329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.575932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:04.584747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8bdec21d-bd05-4b93-89d4-3dc5699e9e04 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.178118 Sep 22 13:13:04.595417 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 223/445] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:04 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:04.657490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:04.658005 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:04.665341 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.666043 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.666981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.667597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.821165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:04.830288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:04.830481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-64696f82-e7b4-4711-ab3c-67485f91a184 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.177232 Sep 22 13:13:04.840266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 223/446] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:04 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:04.842261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:04.852790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.853555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.854377 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.854821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.893358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:04.894236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:04.902615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.903309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:04.904857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:04.905348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.008813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.017691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.019200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.020509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-33584517-8af8-4217-abad-2e3179d2461f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.196356 Sep 22 13:13:05.021073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 224/447] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:04 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:05.054972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.059237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:05.059955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:05.064020 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-08f46fda-b385-4f9a-b7a6-5d6503d76e46 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.174277 Sep 22 13:13:05.065280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 224/448] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:04 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:05.066903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.067402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.068293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.068780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.223331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ccebf2a-af40-476d-9cdd-0f01323ccb4f"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:05.224463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:05.229112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.230640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.231300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.232690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.233372 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.242637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-359649ac-5578-4577-a6d3-693666ffed26 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.189701 Sep 22 13:13:05.243899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 225/449] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:05 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:05.603097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:05.603993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:05.613177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.616532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.617573 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.618573 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.761790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:05.769695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-00d9a02f-88f6-462f-b214-d0335b0452ef tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.170452 Sep 22 13:13:05.770268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 226/450] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:05 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:05.784450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-e88c2501-f5cb-40a8-80ed-abc954050921 req-fee6142a-fe68-4d55-9409-e91ddb7df512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c9c788-beff-4411-a824-3363acb27590", "name": "network-vif-plugged", "status": "completed", "tag": "f332588d-756b-4e7c-abe2-71a2c5b790a6"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:05.789150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:05.789150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:05.793125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e88c2501-f5cb-40a8-80ed-abc954050921 req-fee6142a-fe68-4d55-9409-e91ddb7df512 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.793561 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e88c2501-f5cb-40a8-80ed-abc954050921 req-fee6142a-fe68-4d55-9409-e91ddb7df512 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.804740 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-e88c2501-f5cb-40a8-80ed-abc954050921 req-fee6142a-fe68-4d55-9409-e91ddb7df512 service nova] Creating event network-vif-plugged:f332588d-756b-4e7c-abe2-71a2c5b790a6 for instance 44c9c788-beff-4411-a824-3363acb27590 on hv-cinder-81000 Sep 22 13:13:05.810113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-e88c2501-f5cb-40a8-80ed-abc954050921 req-fee6142a-fe68-4d55-9409-e91ddb7df512 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029034 Sep 22 13:13:05.810713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 227/451] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:05.864064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:05.865065 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:05.872623 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.873220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:05.874096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:05.874637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.020252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.028685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1344e1fb-df84-4b7d-854b-b8d4c9f1131e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.169699 Sep 22 13:13:06.031463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 228/452] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:05 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:06.040791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:06.041570 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:06.047832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.048278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.049051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.049486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.195235 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.204154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.205743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.207222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aa47a797-1260-4c21-863a-e7c51cd5bfdc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.171061 Sep 22 13:13:06.207875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 229/453] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:06 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:06.212189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:06.212874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:06.219604 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.220051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.220819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.221251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.366593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.374862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e0b54179-4890-4976-8c0e-a1b997ae33c6 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.165866 Sep 22 13:13:06.375489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 230/454] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:06 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:06.379876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:06.380471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:06.386573 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.387011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.388354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.389342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.522277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.538265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-875a499b-2558-47e5-b832-2b11ec893f12 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.161752 Sep 22 13:13:06.539611 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 231/455] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:06 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:06.788560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:06.789224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:06.795704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.796637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.796969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:06.797582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:06.948096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:06.956544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f03b104b-ac87-48aa-a3f3-6fb25bbad3dd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.171636 Sep 22 13:13:06.958125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 232/456] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:06 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:07.048739 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:07.054800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:07.055911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.056384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.057149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.057584 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.190178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.197579 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b9e62827-8d0b-45de-95e6-dc4cd6f87d6d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.153345 Sep 22 13:13:07.198133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 233/457] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:07 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:07.225525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:07.226156 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:07.233356 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.233805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.234576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.235008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.394576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.407085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.407085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.408065 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-828dc97b-cc16-487e-a041-6739d1bc5f2f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.186141 Sep 22 13:13:07.409456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 234/458] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:07 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:07.414882 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:07.415832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:07.436321 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.436947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.437622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.437971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.568821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.577855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e4676d7c-2091-4844-9e20-e7e27891d831 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.167025 Sep 22 13:13:07.578823 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 235/459] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:07 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:07.595010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:07.595655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:07.602163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.602611 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.603743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.604968 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.743244 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:07.751766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b7ead7c6-dadc-403a-ae63-4f7c119f6878 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.161390 Sep 22 13:13:07.752331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 236/460] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:07 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:07.974248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:07.974946 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:07.981080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.982043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:07.982993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:07.983520 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.110823 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.118200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b32de370-afe0-4bb9-8ab4-1197fc3cf363 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.147852 Sep 22 13:13:08.145331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 237/461] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:07 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:08.221817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:08.222432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:08.228488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.228867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.229648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.230082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.365696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.373676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ab46a87-cc82-4990-a70e-8c3ae592e7ab tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.155559 Sep 22 13:13:08.374596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 238/462] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:08 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:08.426391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:08.427001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:08.433912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.434373 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.435136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.435623 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.587589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.596673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.598295 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.599669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a52aef09-49eb-4aa3-8c15-71a36a9c3ee0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.177224 Sep 22 13:13:08.609308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 239/463] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:08 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:08.609308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:08.609308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:08.620628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.620628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.620628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.620628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.755051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.761889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c74f09bd-227d-4fe2-a84b-876bf60bfa36 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.160167 Sep 22 13:13:08.762445 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 240/464] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:08 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:08.775499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:08.775499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:08.782037 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.782479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.783259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:08.783997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:08.929814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:08.939190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0b51ddda-6ace-4849-8e76-f18f97eb37f0 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.170423 Sep 22 13:13:08.942499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 241/465] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:08 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:09.137311 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:09.138721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:09.153850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.154390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.155268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.155794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.314590 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:09.321977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a2b73e87-66b2-43a3-a3c0-a5c4b7077f88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.188586 Sep 22 13:13:09.322541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 242/466] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:09 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:09.396045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:09.396689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:09.406926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.407376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.408183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.408887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.555183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:09.562451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7eea22f9-53c4-4f97-82a9-6cbe5d367d04 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.175874 Sep 22 13:13:09.562952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 243/467] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:09 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:09.620922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:09.621539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:09.629591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.630169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.630887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.631326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.800916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:09.814928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:09.816663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:09.818836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-14e13019-5c08-459a-b915-bad34f7addc2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.204080 Sep 22 13:13:09.828121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 244/468] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:09 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:09.834651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:09.836407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:09.843730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.844198 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.845008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:09.845458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:09.994523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.002256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2dfae07e-c54c-42cb-8dd7-00c7c00e9cb0 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.171625 Sep 22 13:13:10.002831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 245/469] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:09 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:10.007251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:10.007875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:10.013839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.014281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.015073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.015528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.148614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.164389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-60a163d3-d27d-4083-bd0b-9c187f876687 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.160473 Sep 22 13:13:10.174765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 246/470] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:10 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:10.339962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:10.341541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:10.348915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.349501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.350268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.350696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.482443 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.489794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-66620189-9fcd-4195-8934-2a9943a94b70 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.154545 Sep 22 13:13:10.490514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 247/471] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:10 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:10.579779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:10.580400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:10.586464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.586919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.587732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.588166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.784450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.791793 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e044386b-d6d2-43d0-ab24-99925d52ff96 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.216643 Sep 22 13:13:10.792370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 248/472] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:10 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:10.838074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:10.838851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:10.845956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.846653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.847654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:10.848466 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:10.983317 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.991728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.993238 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:10.994389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-582f420e-a9b6-4db4-ae70-a958df120b15 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.160732 Sep 22 13:13:10.994940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 249/473] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:10 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:11.022666 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:11.023273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:11.037733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.038191 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.038975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.039473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.212188 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:11.225756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ec005439-b639-45cc-ace0-6fd552c1c2fd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.209357 Sep 22 13:13:11.226798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 250/474] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:11 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:11.235711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:11.236741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:11.245990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.246446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.248032 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.248463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.387298 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:11.397050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e1a21a40-8d22-4975-90a3-9d473fb51070 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.168839 Sep 22 13:13:11.407729 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 251/475] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:11 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:11.508499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:11.509999 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:11.518197 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.518728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.519895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.520411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.660839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:11.668568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34197295-ffea-4b90-9a53-f66e9cf71fb9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.164497 Sep 22 13:13:11.669705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 252/476] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:11 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:11.810301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:11.811255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:11.817526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.818092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.818929 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:11.819453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:11.973710 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:11.981919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-952c35d8-d7b6-4527-a5dc-a64491da8bb9 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.175643 Sep 22 13:13:11.982516 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 253/477] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:11 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:12.014182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:12.015223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:12.022134 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.022784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.023771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.024360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.210114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.221292 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.222810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.224114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-587ebf94-09d7-462b-b568-3e495e213568 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.214785 Sep 22 13:13:12.224677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 254/478] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:12 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:12.242665 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:12.243412 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:12.249484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.249895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.250702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.251145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.416425 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.428608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7555e014-2206-43b8-8b1a-24a3ed95639f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.189493 Sep 22 13:13:12.429771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 255/479] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:12 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:12.441810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:12.442731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:12.449307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.449751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.451219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.451750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.586761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.594441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cdeeb243-5453-4c9b-b64f-2c436be04b0f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.163002 Sep 22 13:13:12.595236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 256/480] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:12 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:12.687745 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:12.688514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:12.694574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.695008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.695802 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:12.696224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:12.828268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:12.835587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4bf75599-35e8-48cf-818b-f9ff2c864ada tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.153016 Sep 22 13:13:12.836163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 257/481] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:12 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:12.998751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:12.999695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:13.016344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.016796 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.017578 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.018009 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.158795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.166144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5540fc3c-63fb-4dd8-ada4-d4a5ea333c7d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.171916 Sep 22 13:13:13.166838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 258/482] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:12 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:13.245452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:13.246131 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:13.252504 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.258697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.258697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.258697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.384732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.394535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.395958 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.397194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-70b5c9a6-bc20-458d-b5a6-5b187ff2c466 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.155462 Sep 22 13:13:13.406069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 259/483] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:13 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:13.445606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:13.446322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:13.453206 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.453732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.454568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.455005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.587222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.596370 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-83f9e80d-8017-4da5-97fd-398eb40b2f27 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.154338 Sep 22 13:13:13.597225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 260/484] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:13 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:13.611361 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:13.612158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:13.618395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.619557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.620452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.620986 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.761944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:13.771362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-629a97b9-534b-4b4a-b45a-d763a1d1b2aa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.163592 Sep 22 13:13:13.772021 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 261/485] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:13 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:13.852682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:13.853284 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:13.859914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.860372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.861187 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:13.861603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:13.992968 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.007032 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5145d00b-6dd2-4885-86e9-066f76c8a53b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.157664 Sep 22 13:13:14.008220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 262/486] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:13 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:14.185232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:14.185963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:14.191685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.192135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.192901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.193326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.349372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.357911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ef85af82-cefb-4327-92c8-3ef02a398ad6 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.176791 Sep 22 13:13:14.368658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 263/487] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:14 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:14.416953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:14.417695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:14.425426 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.425943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.426831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.427374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.579799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.587814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.589319 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.591176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-efb765c3-d991-4142-9b35-f72958579080 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.177512 Sep 22 13:13:14.591787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 264/488] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:14 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:14.616781 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:14.617428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:14.623836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.624333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.625110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.625541 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.771971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.785291 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c01829b-4c83-430b-8fbd-d2846377a599 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.173092 Sep 22 13:13:14.794461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 265/489] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:14 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:14.798592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:14.799326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:14.805711 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.806244 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.807086 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:14.807678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:14.938617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:14.949323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9db9b8ce-aafe-48a4-aaa5-bbf8dd262e94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.161475 Sep 22 13:13:14.951507 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 266/490] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:14 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:15.024260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:15.024866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:15.031652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.032138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.033011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.033697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.166138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.174197 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88548234-261b-4a0f-bb63-68fbac2226bd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.153756 Sep 22 13:13:15.174761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 267/491] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:15 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:15.374657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:15.375367 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:15.381199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.381642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.382405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.382837 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.508285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.516157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-185b6b09-bec8-4269-b9dd-eb01bb87ef89 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.145321 Sep 22 13:13:15.516721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 268/492] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:15 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:15.609278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:15.609992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:15.615956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.616394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.617163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.617583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.740835 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.749380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.750871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.752069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-55311dfc-5d06-48bf-8d50-21b8450b4cf7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.146526 Sep 22 13:13:15.752631 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 269/493] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:15 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:15.801680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:15.802272 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:15.808340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.808786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.810284 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.810716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.935763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:15.943568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9d26c563-c2ef-4140-bce4-b90a061794d5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.145318 Sep 22 13:13:15.944771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 270/494] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:15 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:15.967768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:15.968622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:15.975564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.976241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:15.977190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:15.977775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.123074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.134588 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-21a7b1b8-8305-40eb-af4c-b63a006512dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.168949 Sep 22 13:13:16.136149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 271/495] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:15 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:16.191092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:16.195015 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:16.205625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.206772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.207209 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.207816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.426648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.442994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-25da06a1-bfdf-48b0-85ee-7615016bb3cf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.255429 Sep 22 13:13:16.453681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 272/496] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:16 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:16.534049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:16.534994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:16.541507 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.542035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.542911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.544326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.739064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.746381 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aa6d3274-a2a9-4eac-928b-4774e7263a9b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.216862 Sep 22 13:13:16.747153 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 273/497] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:16 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:16.770904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:16.773515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:16.780258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.780707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.781485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.781924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.953345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.964696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.967306 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:16.968983 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-75931c29-0d9f-43c9-b478-03ea63c06827 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.201497 Sep 22 13:13:16.979480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 274/498] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:16 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:16.979480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:16.979480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:16.992004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.992726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:16.993866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:16.994521 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.099490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-16d77137-ea31-4bdc-8955-5b1667da63e3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.879968 Sep 22 13:13:17.100420 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 225/499] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:13:05 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments => generated 194 bytes in 11882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:17.153886 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:17.168831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:17.168831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.168831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.168831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.169401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.232212 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:17.240419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b4dbce0d-2c21-464b-844d-1f130938f092 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.268169 Sep 22 13:13:17.241267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 275/500] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:16 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:17.459472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:17.460328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:17.468115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.468954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.469739 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.470169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.714169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:17.725553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a78ee96a-24a7-4b00-9948-898c9723e673 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.269737 Sep 22 13:13:17.727592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 276/501] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:17 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:17.739477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:17.744853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-542d7a91-dc09-45d7-8d59-6d7b16c13fd8 req-cc0ac6d9-836c-4b6a-ae4c-ddbd3891306c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:17.748702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:17.748702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:17.749240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cfc6f508-282f-40a5-8999-2855363a5fa5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.599624 Sep 22 13:13:17.757110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-542d7a91-dc09-45d7-8d59-6d7b16c13fd8 req-cc0ac6d9-836c-4b6a-ae4c-ddbd3891306c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.757337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 226/502] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:17 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:17.758779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-542d7a91-dc09-45d7-8d59-6d7b16c13fd8 req-cc0ac6d9-836c-4b6a-ae4c-ddbd3891306c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.763952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:17.767126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:17.772948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-542d7a91-dc09-45d7-8d59-6d7b16c13fd8 req-cc0ac6d9-836c-4b6a-ae4c-ddbd3891306c service nova] Creating event network-changed:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:13:17.785827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.785827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.786007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-542d7a91-dc09-45d7-8d59-6d7b16c13fd8 req-cc0ac6d9-836c-4b6a-ae4c-ddbd3891306c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049293 Sep 22 13:13:17.786100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:17.786100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:17.786265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 277/503] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:17.989432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:17.990122 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:17.999757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.000056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.000774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.001201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.022466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.031685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-09637144-ac9d-4a03-954c-8b0d9d1cca67 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.271457 Sep 22 13:13:18.032853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 227/504] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:17 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:18.157551 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.165503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.170721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.170721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8c2778ef-c2f2-41e2-8465-307fac2d42a2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1744 microversion: 2.20 time: 0.183150 Sep 22 13:13:18.170721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 278/505] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:17 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:18.257471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:18.258214 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:18.264379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.264830 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.265608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.266037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.394895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.402421 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c158e1de-2cba-4b00-b290-b0c00b7b46b5 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.148634 Sep 22 13:13:18.403993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 228/506] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:18 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:18.744693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:18.745493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:18.753224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.754132 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.755242 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.755861 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.768666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:18.769277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:18.777078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.777512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.780887 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:18.781573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:18.896376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:18.906166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-007076a8-a465-42e9-98f3-f1206c616c79 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1317 microversion: 2.1 time: 0.165736 Sep 22 13:13:18.907674 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 279/507] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:18 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:19.010102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.018236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8e0131eb-96c7-48c3-9598-7b8daa04ca68 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.253462 Sep 22 13:13:19.019731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 229/508] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:18 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:19.049822 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:19.050423 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:19.056669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.057124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.068199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.068199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.188871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:19.189495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.189666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:19.196520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.196949 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.197728 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.197951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c7ae3eac-0bf1-4af7-a27c-211033645fa7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.151703 Sep 22 13:13:19.198147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.199023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 280/509] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:19 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:19.404585 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.413792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.417264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.417264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7b155511-0355-46a7-89fc-ab8cc99e95c2 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1744 microversion: 2.20 time: 0.232668 Sep 22 13:13:19.417472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 230/510] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:19 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:19.423727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:19.424698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:19.432513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.433118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.435333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.435902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.578855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:19.588329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b319c926-3cfc-4aa6-9d62-a0faa0f1b60f tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.171034 Sep 22 13:13:19.589116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 281/511] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:19 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:19.658547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-d923a9ac-13c9-48b5-be18-e18ab07cda08 req-9631370e-d3d0-4144-abb2-0b1b9a6e90fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "name": "network-vif-plugged", "status": "completed", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:19.660193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:19.660193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:13:19.667702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-d923a9ac-13c9-48b5-be18-e18ab07cda08 req-9631370e-d3d0-4144-abb2-0b1b9a6e90fb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.668184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-d923a9ac-13c9-48b5-be18-e18ab07cda08 req-9631370e-d3d0-4144-abb2-0b1b9a6e90fb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.679400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-d923a9ac-13c9-48b5-be18-e18ab07cda08 req-9631370e-d3d0-4144-abb2-0b1b9a6e90fb service nova] Creating event network-vif-plugged:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:13:19.685610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-d923a9ac-13c9-48b5-be18-e18ab07cda08 req-9631370e-d3d0-4144-abb2-0b1b9a6e90fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031197 Sep 22 13:13:19.686196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 231/512] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:19.924501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:19.927159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:19.935082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.935571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:19.936338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:19.936769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.037898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:20.039458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:20.047715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.048653 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.049866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.050509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.094157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.109054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a351f1aa-43c7-47f5-986b-28db9037900e tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1507 microversion: 2.1 time: 0.188091 Sep 22 13:13:20.120165 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 282/513] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:19 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:20.221026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:20.221941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:20.234221 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.234942 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.235203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.237271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.237271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.251903 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9782d697-5875-46ab-8e31-635e833f070d tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1509 microversion: 2.1 time: 0.219250 Sep 22 13:13:20.259187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 232/514] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:20 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:20.393474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.401101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9590c050-8e7d-4de6-9402-674f0e12d3a7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.188439 Sep 22 13:13:20.401992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 283/515] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:20 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:20.436644 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:20.437316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:20.443863 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.444300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.445068 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.445534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.605392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.612694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:20.613552 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:20.621406 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.625969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.628225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.629114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.630794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a5b12832-4aa5-4ee8-8a55-06b334801a94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.198121 Sep 22 13:13:20.631812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:20.632319 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:20.633465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 233/516] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:20 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:20.793326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:20.805659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ad0d4596-f866-4212-8653-14116081e0bd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.203295 Sep 22 13:13:20.807224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 284/517] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:20 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:21.276095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:21.277131 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:21.284411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.284990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.286016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.286564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.420644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:21.422194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:21.429971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.430886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.431962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.432469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.438462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:21.453206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b0a9aba6-d02b-4811-887e-e37bc1587e29 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1515 microversion: 2.1 time: 0.180983 Sep 22 13:13:21.454553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 234/518] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:21 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:21.642132 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:21.653440 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:21.653718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-769b99b8-f6e5-415c-a6cc-bbfb12193eca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.238231 Sep 22 13:13:21.654884 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 285/519] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:21 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:21.663770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:21.673940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.674487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.675359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.675875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.831694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:21.832360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:21.842176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.842625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.843455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:21.843969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:21.911992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:21.926921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:21.934594 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:21.941747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b866773a-331d-480d-80ac-363dbfc976f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.293200 Sep 22 13:13:21.948095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 235/520] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:21 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:22.044405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-7d55607a-367b-41ae-932f-7d1e6c0fc994 req-77c2bdac-bf55-4b22-af4e-e9c6c723b5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e80789-599b-40eb-a28c-7bb59a54e6df", "name": "network-vif-plugged", "status": "completed", "tag": "623ab9c0-8903-4af9-8bc6-bd4560116795"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:22.045974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:22.045974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:13:22.053546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-7d55607a-367b-41ae-932f-7d1e6c0fc994 req-77c2bdac-bf55-4b22-af4e-e9c6c723b5eb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.055343 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-7d55607a-367b-41ae-932f-7d1e6c0fc994 req-77c2bdac-bf55-4b22-af4e-e9c6c723b5eb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.057118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:22.069585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d6fc8a27-f28b-4c9c-a7e9-5156724e88cd tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.241752 Sep 22 13:13:22.083695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 286/521] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:21 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:22.097425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-7d55607a-367b-41ae-932f-7d1e6c0fc994 req-77c2bdac-bf55-4b22-af4e-e9c6c723b5eb service nova] Creating event network-vif-plugged:623ab9c0-8903-4af9-8bc6-bd4560116795 for instance 87e80789-599b-40eb-a28c-7bb59a54e6df on hv-cinder-81000 Sep 22 13:13:22.103260 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-7d55607a-367b-41ae-932f-7d1e6c0fc994 req-77c2bdac-bf55-4b22-af4e-e9c6c723b5eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062811 Sep 22 13:13:22.105145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 236/522] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:22.670689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:22.671292 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:22.685457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.685909 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.686950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.687589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.803479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e9caa7a-c950-4a4f-9a96-83196b963ec0"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:22.812027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:22.819929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.820738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.824992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.824992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.861717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:22.870049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d3f866c1-6bd0-4e15-9f6f-139e65876036 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.203306 Sep 22 13:13:22.870310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 287/523] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:22 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:22.966050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:22.966603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:22.974096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.974828 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:22.975646 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:22.976088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.140002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:23.150383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:23.151920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:23.153402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ec9e79dd-5994-47c1-a862-cb51747c472e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.191232 Sep 22 13:13:23.154172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 288/524] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:22 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:23.179528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:23.179528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:23.185181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.190287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.190287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.190287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.357392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:23.365465 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0671679f-5726-460d-9a3f-6afe4084b0d9 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1314 microversion: 2.1 time: 0.192892 Sep 22 13:13:23.366598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 289/525] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:23 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:23.391415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:23.392451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:23.400497 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.406152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.406152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.406152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.559796 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:23.580587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3d20e192-c4b4-40d0-b5ce-df1a367c16de tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1515 microversion: 2.1 time: 0.193938 Sep 22 13:13:23.583202 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 290/526] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:23 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:23.608433 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46fa3ce6-95f9-48f5-89c3-6cc16c5aeab1"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:23.609649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:23.616532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.622648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:23.622648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:23.622648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.420155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3f521221-727f-45ec-afe0-420336f9fcad tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "POST /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.620977 Sep 22 13:13:24.421423 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 237/527] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:13:22 2021] POST /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 194 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:24.435986 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:24.436711 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:24.443460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.443931 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.445037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.445482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.625216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:24.641353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-eccad063-590f-4d92-a44d-ac4a596adf1c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.217497 Sep 22 13:13:24.645625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 238/528] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:24 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:24.667553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:24.669505 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:24.686340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.686340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.686340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.687181 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.850982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:24.861251 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:24.863039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:24.864259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7035da90-f57c-4765-9997-389324f8ab2a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.215268 Sep 22 13:13:24.864802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 239/529] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:24 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:24.869382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:24.870311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:24.877397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.880309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:24.880309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:24.880309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.040955 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:25.052342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e0591659-438e-4810-86ca-485c4760cb13 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1498 microversion: 2.1 time: 0.186205 Sep 22 13:13:25.053178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 240/530] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:24 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:25.125251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a28e8c0e-0d99-409f-91bc-6794376fe229 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.521225 Sep 22 13:13:25.127265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 291/531] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:13:23 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments => generated 194 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:25.666397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:25.668571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:25.675913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:25.676611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.677637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:25.678342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.833985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:25.850594 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2bd56c82-2e4e-489c-862c-8145a2586800 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.191279 Sep 22 13:13:25.852337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 241/532] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:25 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:25.875075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-7b6ef2ff-47d3-4a67-86b3-dfc2b3040443 req-aa1c7e7c-a40c-4eea-9712-5f0101045465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "name": "network-vif-plugged", "status": "completed", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:25.876794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:25.876794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:25.884964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:25.885810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:25.893168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:25.896029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.896029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:25.896299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-7b6ef2ff-47d3-4a67-86b3-dfc2b3040443 req-aa1c7e7c-a40c-4eea-9712-5f0101045465 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:25.896423 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.896533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-7b6ef2ff-47d3-4a67-86b3-dfc2b3040443 req-aa1c7e7c-a40c-4eea-9712-5f0101045465 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:25.917405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-7b6ef2ff-47d3-4a67-86b3-dfc2b3040443 req-aa1c7e7c-a40c-4eea-9712-5f0101045465 service nova] Creating event network-vif-plugged:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:13:25.925054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-7b6ef2ff-47d3-4a67-86b3-dfc2b3040443 req-aa1c7e7c-a40c-4eea-9712-5f0101045465 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056019 Sep 22 13:13:25.926789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 292/533] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:26.221310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:26.231408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:26.233619 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:26.234866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4af7a75b-61bb-4321-90e2-9c9ffe969b62 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.353983 Sep 22 13:13:26.235786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 242/534] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:25 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:26.868724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:26.872855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:26.880940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:26.881843 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:26.883354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:26.883962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:27.069380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:27.086308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7bc996b-7cd9-45a5-8977-bb301e34348e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.221512 Sep 22 13:13:27.086980 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 293/535] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:26 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:27.138530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:27.138997 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:27.145655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:27.146095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:27.146895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:27.147326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:27.188401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:13:27.221923 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8a87b7a-b1e1-4899-a62d-30372c37aa4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:27.228342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8a87b7a-b1e1-4899-a62d-30372c37aa4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:27.228769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8a87b7a-b1e1-4899-a62d-30372c37aa4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:27.335102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8a87b7a-b1e1-4899-a62d-30372c37aa4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Going to try to stop instance {{(pid=109168) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 22 13:13:28.030394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8a87b7a-b1e1-4899-a62d-30372c37aa4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 202 len: 0 microversion: 2.1 time: 0.812105 Sep 22 13:13:28.035635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 294/536] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:27 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:13:28.039977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:28.040893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:28.048766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.049474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.050543 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.051133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.124422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-219918d8-ffa2-4253-8eca-26952e3660ca tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 204 len: 0 microversion: 2.1 time: 0.989670 Sep 22 13:13:28.128183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 243/537] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:13:27 2021] DELETE /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:13:28.135706 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:28.136996 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:28.151260 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.173685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.173685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.173685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.203057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.217950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.225316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.225316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6057e319-14ce-43a9-9fdd-401f652a4427 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.184826 Sep 22 13:13:28.229374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 295/538] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:28 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:28.235839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:28.236615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:28.244014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.245507 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.246452 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.247133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.332456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.342690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8d5b764d-fda2-442a-8cc0-2fbed0852ad5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.216055 Sep 22 13:13:28.344229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 244/539] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:28 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:28.349749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:28.350654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:28.374312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.377968 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.379167 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:28.380023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:28.441276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.463943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-06013b13-f169-446b-8d04-d305870a5b9c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1359 microversion: 2.1 time: 0.218425 Sep 22 13:13:28.463943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 296/540] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:28 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:28.538359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:28.546712 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-06e5079b-d44a-4761-9c72-627def042127 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1504 microversion: 2.1 time: 0.200813 Sep 22 13:13:28.547293 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 245/541] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:28 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:29.241945 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.243232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:29.249692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.250402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.251360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.251819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.361233 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.362658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:29.368839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.372416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.373727 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.374369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.396698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.405847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.407928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.409265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9908b123-8d15-4273-af36-c80ef1f99f33 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.173657 Sep 22 13:13:29.410355 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 297/542] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:29.468155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.468994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:29.494869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.495314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.496814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.497267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.551173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.568757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-27f69f75-e6e5-4967-a957-a3c302fac4b2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.211021 Sep 22 13:13:29.579487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 246/543] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:29.579487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.579487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:29.583355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.583984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.585048 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.585876 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.713053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.722256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20f2f8a2-d223-40b5-8456-ffc6b7ccf470 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1549 microversion: 2.1 time: 0.258270 Sep 22 13:13:29.737722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 298/544] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1549 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:29.742701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.743574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:29.745974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.750160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.750819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.751632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.752065 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.754029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-261f1c19-a9f1-4368-835a-3ed996e25217 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1504 microversion: 2.1 time: 0.182696 Sep 22 13:13:29.755661 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 247/545] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:29.890078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.908666 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-68abe59d-bf38-4500-9617-028f103fbf94 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1549 microversion: 2.1 time: 0.169386 Sep 22 13:13:29.920283 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 299/546] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:29.927122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:29.931369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:29.931369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:13:29.932643 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:29.933677 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Searching by: {'deleted': False, 'project_id': '71b37942aed94a0193ab222fd05836ab'} {{(pid=109167) get_all /opt/stack/nova/nova/compute/api.py:2905}} Sep 22 13:13:29.955113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.959117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:29.959117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:29.959117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.084265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.multi_cell_list [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=109167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 22 13:13:30.196687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b788b8bf-d064-48a4-8913-1f28969e211f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.274911 Sep 22 13:13:30.203127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 248/547] 10.222.0.43 () {58 vars in 1125 bytes} [Wed Sep 22 13:13:29 2021] GET /compute/v2.1/servers => generated 343 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:30.207610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:30.208250 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:30.230205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.230205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.230205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.230205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.427957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:30.429031 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:30.430114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:30.439407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.441100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.442116 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.442706 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.445838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-173a6559-14e3-441f-b5c3-67ffb113d238 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1549 microversion: 2.1 time: 0.241359 Sep 22 13:13:30.459458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 300/548] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:30 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1549 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:30.595222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:30.596675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:30.610333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.611509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.613472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.614499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.817346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:30.828826 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:30.830925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:30.833376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-71014bcd-fa8c-4960-ac64-214f45ddfba4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.408001 Sep 22 13:13:30.834770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 249/549] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:30 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:30.848472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:30.849396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:30.856458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.857713 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.858692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:30.859303 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:30.895383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:30.907885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-add558b7-0472-49bf-8852-f35e1e3e03ad tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.320640 Sep 22 13:13:30.913011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 301/550] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:30 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:31.124705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:31.135395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8a44ca6e-ee3e-4b1e-a5c4-094e7ff684c3 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1504 microversion: 2.1 time: 0.299021 Sep 22 13:13:31.152196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 250/551] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:30 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:31.851643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:31.852379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:31.858831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:31.869278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:31.869278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:31.869278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:31.924439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:31.925028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:31.930941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:31.931391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:31.932338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:31.932836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:32.000764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:32.016901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:32.019782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:32.021274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6d9f1598-ffa3-4f9e-a927-6a1d2eb1887a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.173264 Sep 22 13:13:32.022357 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 302/552] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:31 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:32.087784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-93257781-a114-496c-8a82-43faddc97f18 req-35ab4169-3825-4e91-aa1d-bbb39e6e2b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e80789-599b-40eb-a28c-7bb59a54e6df", "name": "network-vif-deleted", "tag": "623ab9c0-8903-4af9-8bc6-bd4560116795"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:32.091375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:32.091375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:32.100390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-93257781-a114-496c-8a82-43faddc97f18 req-35ab4169-3825-4e91-aa1d-bbb39e6e2b4e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:32.109033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-93257781-a114-496c-8a82-43faddc97f18 req-35ab4169-3825-4e91-aa1d-bbb39e6e2b4e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:32.122660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-93257781-a114-496c-8a82-43faddc97f18 req-35ab4169-3825-4e91-aa1d-bbb39e6e2b4e service nova] Creating event network-vif-deleted:623ab9c0-8903-4af9-8bc6-bd4560116795 for instance 87e80789-599b-40eb-a28c-7bb59a54e6df on hv-cinder-81000 Sep 22 13:13:32.140584 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-93257781-a114-496c-8a82-43faddc97f18 req-35ab4169-3825-4e91-aa1d-bbb39e6e2b4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057715 Sep 22 13:13:32.142013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 303/553] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:32.160726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:32.180787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:32.180787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:32.180787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:32.184226 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:32.186250 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:32.249976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:32.261520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1fcdafd0-b421-4264-b27b-3e17526e1cbf tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.340877 Sep 22 13:13:32.263710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 251/554] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:31 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:32.271746 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:32.278460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-45528484-393c-4f85-903d-7708c22297fb tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1462 microversion: 2.1 time: 0.121740 Sep 22 13:13:32.279470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 304/555] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:32 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:33.045053 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:33.045583 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:33.051554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.052001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.053112 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.053237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.190904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:33.199268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:33.201029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:33.202189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ee4c1ead-e2fd-4fae-8bb6-132cd2c54f6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1739 microversion: 2.20 time: 0.161949 Sep 22 13:13:33.202749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 252/556] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:33 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:33.279849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:33.281072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:33.287482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.288101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.295757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.295757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.296167 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:33.296389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:33.302307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.302749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.305176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.305176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.339647 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.339938 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.340546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lazy-loading 'fault' on Instance uuid 87e80789-599b-40eb-a28c-7bb59a54e6df {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:13:33.382612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b51719cefc4d2d94d766b18ffab5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99723145834860a6127632c31447c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:33.398756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-29e4443d-981a-46b1-9b3c-a4c2b04c3c9a tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 200 len: 1304 microversion: 2.1 time: 0.105992 Sep 22 13:13:33.398756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 253/557] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:33 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:33.444001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:33.452236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-08263195-8aa2-407b-9b09-157141b4214f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.176350 Sep 22 13:13:33.452813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 305/558] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:33 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:33.477364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:33.479032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:33.487369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.488032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:33.488929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:33.489577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.220887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:34.221593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:34.227833 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.228403 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.229272 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.229888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.351698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:34.359764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:34.361342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:34.362511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-597f28d8-f50c-4930-89b4-e5d6dce8dd98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1721 microversion: 2.20 time: 0.145717 Sep 22 13:13:34.363071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 306/559] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:34 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:34.392030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-22428b96-2888-42df-aa22-125701aa3dbb tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919402 Sep 22 13:13:34.393312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 254/560] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:13:33 2021] POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:34.418396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:34.420416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] [instance: 87e80789-599b-40eb-a28c-7bb59a54e6df] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:34.429110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.429873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.431310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.431931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.447973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] HTTP exception thrown: Instance 87e80789-599b-40eb-a28c-7bb59a54e6df could not be found. Sep 22 13:13:34.449466 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] Returning 404 to user: Instance 87e80789-599b-40eb-a28c-7bb59a54e6df could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:13:34.450564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f20f4d38-94d6-4213-b24a-98249e9e7455 tempest-VolumesActionsTest-542356694 tempest-VolumesActionsTest-542356694-project] 10.222.0.43 "GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df" status: 404 len: 111 microversion: 2.1 time: 0.036261 Sep 22 13:13:34.451486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 307/561] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:34 2021] GET /compute/v2.1/servers/87e80789-599b-40eb-a28c-7bb59a54e6df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:13:34.471049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:34.471925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:34.478205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.478903 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.480163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:34.480771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:34.702844 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:34.711925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1c49ea89-1a6f-4607-a4c9-01d5d8ed4e4d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.245020 Sep 22 13:13:34.712492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 255/562] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:34 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:35.177346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:35.177847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:35.184438 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.184886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.185655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.186089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.322027 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'services' on Instance uuid 44c9c788-beff-4411-a824-3363acb27590 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:13:35.380856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:35.381799 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:35.388282 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.388733 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.389502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.390045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.529206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:35.540943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:35.552747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:35.553536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9dc194fe-bc02-4e70-b618-30cf4e8de1af tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments/3e9caa7a-c950-4a4f-9a96-83196b963ec0" status: 202 len: 0 microversion: 2.1 time: 0.379713 Sep 22 13:13:35.553986 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1e68648f-1a0b-4337-8b33-e8215e07ba79 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1721 microversion: 2.20 time: 0.176850 Sep 22 13:13:35.554428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 308/563] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:13:35 2021] DELETE /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments/3e9caa7a-c950-4a4f-9a96-83196b963ec0 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:13:35.554604 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 256/564] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:35 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:35.563547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:35.564916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:35.581201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.581911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.582953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.583340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.615309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b0394e79-4a73-454c-b1d2-e6394540e450 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055960 Sep 22 13:13:35.615998 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 257/565] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:35 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:35.730479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:35.731317 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:35.737628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.738081 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.738864 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:35.739304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:35.867261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:35.875626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9618f9f4-5c49-44f2-826b-6cd0aaf13bf0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.149858 Sep 22 13:13:35.876209 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 309/566] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:35 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:36.574117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:36.574744 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:36.581349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.581556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:36.584252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.584252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:36.632441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:36.633415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:36.640158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.640903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:36.645987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.645987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:36.686632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ce2ab0ed-d24e-4fad-a073-dacc21df3212 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051384 Sep 22 13:13:36.686632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 310/567] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:36 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:36.712967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:36.721792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:36.725186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:36.725186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1b19de2c-e727-4943-b1fe-b137aac0032d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1721 microversion: 2.20 time: 0.154588 Sep 22 13:13:36.725186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 258/568] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:36 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:36.891988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:36.892676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:36.898403 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.898865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:36.899656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:36.900089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:37.022872 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:37.033119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a13e4fa9-32d5-434d-b326-524bcc1b3873 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.144780 Sep 22 13:13:37.034649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 311/569] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:36 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:37.693718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:37.694705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:37.702270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:37.703495 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:37.703610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:37.704053 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:37.733327 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8c947a62-db3e-4ff9-99d0-5ec2bb6dbd87 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Sep 22 13:13:37.733897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 259/570] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:37 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:37.743376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:37.749274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:37.750979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:37.751536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:37.752469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:37.753301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:37.893940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:37.901823 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:37.903376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:37.904526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-de731e3f-fa13-413b-890f-1b4023699113 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1721 microversion: 2.20 time: 0.164885 Sep 22 13:13:37.905092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 312/571] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:37 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:38.049802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:38.050405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:38.056219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.063512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:38.063512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.063512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:38.179797 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:38.188421 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c10077c1-f5b4-4efd-a377-ab548c33536e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.142234 Sep 22 13:13:38.188973 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 260/572] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:38 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:38.745204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:38.747527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:38.754019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.754424 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:38.755172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.755650 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:38.788401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-53a2caba-5c2b-4be8-8911-f0d4d747e6fb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047173 Sep 22 13:13:38.789125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 313/573] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:38 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:38.921920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:38.922514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:38.928565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.929103 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:38.929982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:38.930497 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.057006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:39.065455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:39.066945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:39.068138 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8229c2d5-f0b8-4980-ac53-678b31165dc4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1721 microversion: 2.20 time: 0.150010 Sep 22 13:13:39.068692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 261/574] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:38 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:39.205309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:39.205922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:39.211825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:39.212266 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.213031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:39.213465 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.343953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:39.356870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4d14364a-b0cf-468f-9512-f3a04f097ff5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.154883 Sep 22 13:13:39.357994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 314/575] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:39 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:39.630948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-07482f87-9cc4-4764-b231-ed3593eb6762 req-19fb496b-4b47-4642-bf52-bd4af2a56ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "name": "network-vif-unplugged", "status": "completed", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:39.632554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:39.632554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:13:39.640461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-07482f87-9cc4-4764-b231-ed3593eb6762 req-19fb496b-4b47-4642-bf52-bd4af2a56ac7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:39.641109 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-07482f87-9cc4-4764-b231-ed3593eb6762 req-19fb496b-4b47-4642-bf52-bd4af2a56ac7 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.652578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-07482f87-9cc4-4764-b231-ed3593eb6762 req-19fb496b-4b47-4642-bf52-bd4af2a56ac7 service nova] Creating event network-vif-unplugged:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:13:39.658003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-07482f87-9cc4-4764-b231-ed3593eb6762 req-19fb496b-4b47-4642-bf52-bd4af2a56ac7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030704 Sep 22 13:13:39.658846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 262/576] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:39.801246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:39.803170 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:39.810205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:39.810845 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.824751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:39.825210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:39.880535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d025e8e9-2053-452b-8de1-b2c1f3602e88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084198 Sep 22 13:13:39.881110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 315/577] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:39 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:40.087632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:40.088241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:40.094691 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.095139 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.095984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.096415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.219605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:40.227401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:40.228916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:40.230741 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e897124a-04ad-4104-8c87-f3e1499d885b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1724 microversion: 2.20 time: 0.147459 Sep 22 13:13:40.231287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 263/578] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:40 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:40.254382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ce6329f-dd43-4587-b139-82bf9bdabe15"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:40.255562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:40.261584 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.262028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.262859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.263297 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.375130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:40.375684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:40.381549 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.381991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.382782 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.383211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.510146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:40.518134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-458ecb27-d361-412e-9f55-0bc8bbc95cd0 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.146947 Sep 22 13:13:40.518716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 264/579] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:40 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:40.892453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:40.893370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:40.899364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.899825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.900596 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:40.901638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:40.934651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f3db1089-8aa5-4875-a618-0a29a60dc92d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Sep 22 13:13:40.935348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 265/580] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:40 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:41.542469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:41.544887 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:41.556529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6d3b4f21-fc1d-48e2-9067-827a0dd336ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.306068 Sep 22 13:13:41.559661 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 316/581] 10.222.0.43 () {62 vars in 1364 bytes} [Wed Sep 22 13:13:40 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments => generated 188 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:13:41.586556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.588873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:41.588873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.590703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:41.718537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:41.719245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:41.734338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.734338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:41.734338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.734338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:41.757283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:41.767408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f4ce9db3-539a-4daf-8394-e6abfcc4d778 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.232657 Sep 22 13:13:41.767408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 266/582] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:41 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:41.946375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:41.948732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:41.958506 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.959284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:41.960370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:41.961008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:42.031007 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-68d8cc09-97f6-4c09-b85d-15300a20645f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089113 Sep 22 13:13:42.032603 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 267/583] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:41 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:42.114405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0384f7fa-bcbf-42e0-a3d3-3be886b5a3ce tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action" status: 202 len: 0 microversion: 2.20 time: 0.400043 Sep 22 13:13:42.115713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 317/584] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:13:41 2021] POST /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:13:42.124810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:42.126010 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:42.133980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:42.134719 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:42.136637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:42.137409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:42.331068 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:42.340580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:42.383701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:42.383701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-98cb12e9-05c3-4a60-8fc6-7a011ee7e642 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1750 microversion: 2.20 time: 0.250357 Sep 22 13:13:42.383701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 268/585] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:42 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:42.784830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:42.786141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:42.793074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:42.793502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:42.794566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:42.795196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:42.952130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:42.960357 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-298946bf-b5c8-4c6e-935b-17cc4aa391d4 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.179624 Sep 22 13:13:42.960957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 318/586] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:42 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:43.045897 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:43.047872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:43.054000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.054655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.055637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.056088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.105961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ffd51a40-5b54-46a7-b4d3-ad3809dede21 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063764 Sep 22 13:13:43.107947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 269/587] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:43 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:43.309558 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:43.311402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:43.319658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.320350 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.321349 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.321943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.352098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lazy-loading 'flavor' on Instance uuid 62dd1478-ba12-4a46-8c78-62519c2c512b {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:13:43.397047 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:43.398036 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:43.405455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.406334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.407702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.408298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.561230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:43.572163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:43.574132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:43.575327 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-09491cba-3765-4628-8fcd-b7024d3f4e1e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1750 microversion: 2.20 time: 0.182240 Sep 22 13:13:43.575915 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 270/588] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:43 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:43.902585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-65047d35-55e7-422c-8049-a949577fcf0a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action" status: 200 len: 32 microversion: 2.1 time: 0.599957 Sep 22 13:13:43.903927 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 319/589] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:43 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action => generated 32 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:13:43.919264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:43.920338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:43.930353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.930945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.932053 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.933298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.979737 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:43.980865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:43.987363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.988028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:43.989114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:43.989846 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:44.436308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:44.450186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ffec9aa4-3d0f-478d-b899-7d8ded529d77 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.472443 Sep 22 13:13:44.451533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 320/590] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:43 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:44.466675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:44.468624 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:44.476877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:44.478449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:44.480797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:44.482036 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:44.518166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4352224e-993b-4df9-9054-6a1b22ce1e29 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064986 Sep 22 13:13:44.524708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 321/591] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:44 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:44.606652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:44.607268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:44.613104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:44.613614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:44.614392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:44.614830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:44.622693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:44.630919 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9c7bc8bf-d219-43d7-9126-02662d838e19 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.721451 Sep 22 13:13:44.633155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 271/592] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:43 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:44.759946 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:44.768110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:44.769674 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:44.771020 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d4fa6fca-e339-4c24-b9e9-edc900703088 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1750 microversion: 2.20 time: 0.168705 Sep 22 13:13:44.771636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 322/593] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:44 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:45.468608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:45.469389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:45.475695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.476259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.477162 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.477677 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.533029 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:45.535373 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:45.544457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.545174 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.546106 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.546671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.590486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8271f2ea-7b11-4974-81aa-9111289ed3a0 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063199 Sep 22 13:13:45.591157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 323/594] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:45 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:45.651047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:45.651047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:45.664911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.665825 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.667550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.667971 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:45.668479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.679870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ae66c194-bffa-47cd-8624-1522073abd68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.215252 Sep 22 13:13:45.680434 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 272/595] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:45 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:45.794021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:45.794929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:45.810776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.811753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.812825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:45.813441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:45.813912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:45.826396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7e059adf-8bf2-4c9c-a9c7-cf1cc45d60ae tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.179677 Sep 22 13:13:45.827180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 324/596] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:45 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:45.958009 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:45.965009 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:45.967091 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:45.968319 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b4f4ccab-fdb0-4425-a716-31ec7743a0e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1750 microversion: 2.20 time: 0.182068 Sep 22 13:13:45.969057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 273/597] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:45 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:46.602934 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:46.605498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:46.614602 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.619302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:46.619302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.619302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:46.699654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:46.699654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:46.701726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e580080a-0a11-48ee-8a00-fc53c44ba9c6 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103358 Sep 22 13:13:46.703970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 325/598] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:46 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:46.706768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.707116 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:46.708761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.709730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:46.846638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:46.847331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:46.856035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.856751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:46.857791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:46.858870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:47.008029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:47.022175 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-424134e9-d653-42c2-ae86-b7de0435193b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.328097 Sep 22 13:13:47.023268 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 274/599] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:46 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:47.038849 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:47.043573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:47.050824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:47.064446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e3ab51c1-6cdf-4ed2-aaf2-0b0a8b9b6fe4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.223329 Sep 22 13:13:47.067669 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:47.068367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:47.069356 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:47.069978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:47.078172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 326/600] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:46 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:47.227499 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:47.243578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:47.256947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:47.258921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d04cf8e7-c2d7-47d0-b855-89b1e5ec1b0c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.233852 Sep 22 13:13:47.261388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 275/601] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:47 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:47.714496 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:47.716653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:47.724048 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:47.724619 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:47.725540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:47.726475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:47.765026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-652aa0d3-7274-4840-ad29-6331db2546ba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054406 Sep 22 13:13:47.765698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 327/602] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:47 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:48.044582 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:48.045771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:48.058589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.058589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.058589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.058589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.084867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:48.085632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:48.092992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.095889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.096928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.100340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.209032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:48.219211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fa23c015-ed6c-4105-9fbb-3cd563827dda tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.181765 Sep 22 13:13:48.229641 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 276/603] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:48 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:48.243096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:48.252853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fabec13f-f067-45fc-aba6-c5c89deefdec tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.170849 Sep 22 13:13:48.253554 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 328/604] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:48 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:48.282705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:48.283721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:48.289824 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.290536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.292201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.292941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.436229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:48.445133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:48.447843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:48.449319 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a7b62ad3-6b16-4a46-baa7-cd60a27aea6e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.170656 Sep 22 13:13:48.450384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 277/605] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:48 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:48.778379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:48.779582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:48.786660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.787269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.788246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:48.788782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:48.825346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6140762d-bfaa-4d51-80fa-5c19c8642936 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052010 Sep 22 13:13:48.826592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 329/606] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:48 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:49.237672 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:49.238945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:49.245736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.246171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.246991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.247416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.270323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:49.271267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:49.278455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.279161 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.282621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.291749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.430951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:49.449006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9e3410f5-0c70-40d5-b782-827642a4a630 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1724 microversion: 2.1 time: 0.213674 Sep 22 13:13:49.450908 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 278/607] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:49 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:49.469069 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:49.469862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:49.479666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.480460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.481482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.482120 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.504768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:49.518566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9bbf3393-2f18-45b2-be59-c0c12eede93f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.251794 Sep 22 13:13:49.528490 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 330/608] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:49 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:49.659963 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:49.670479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:49.672274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:49.673585 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6d086326-7833-46a7-9d42-3ab9d78955c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.208220 Sep 22 13:13:49.674147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 279/609] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:49 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:49.838916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:49.840501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:49.849715 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.851118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.851256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:49.851693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:49.885600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7211232e-1bb2-4c0d-ace1-5d750d2540d9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Sep 22 13:13:49.886935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 331/610] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:49 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:50.467064 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:50.467693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:50.476926 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.477714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.479791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.480400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.536344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:50.537153 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:50.544213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.544950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.545799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.546527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.693735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:50.703364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e6509274-7973-4b9f-84a8-5fcfcc011c67 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.170766 Sep 22 13:13:50.715567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 332/611] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:50 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:50.719943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:50.721190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:50.722247 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:50.729054 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b75245ab-c02c-445a-9aa0-88b8a8d58091 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1701 microversion: 2.1 time: 0.265983 Sep 22 13:13:50.730284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 280/612] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:50 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1701 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:50.731481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.732091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.733055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.733666 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.747794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-62229cb9-d053-46e9-adc3-2eee502324ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:50.754265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-62229cb9-d053-46e9-adc3-2eee502324ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.754581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-62229cb9-d053-46e9-adc3-2eee502324ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.840248 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-62229cb9-d053-46e9-adc3-2eee502324ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Going to try to start instance {{(pid=109167) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 22 13:13:50.913771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:50.930647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:50.931220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:50.933290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-07c5ab73-25f7-423f-90c0-19160cb79c4e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.216274 Sep 22 13:13:50.934039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 333/613] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:50 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:50.938783 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:50.940083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:50.949656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.950375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.951329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:50.951786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:50.987644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3929293f-3f20-4ed1-bec9-22f5a9eb09e3 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052237 Sep 22 13:13:50.988567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 334/614] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:50 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:51.155528 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-62229cb9-d053-46e9-adc3-2eee502324ba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 202 len: 0 microversion: 2.1 time: 0.412268 Sep 22 13:13:51.156394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 281/615] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:13:50 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:13:51.164753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:51.165663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:51.172727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.173167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:51.174180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.174491 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:51.394265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:51.394265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-859a376e-c637-4c54-b3e8-11b49d55d0c7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1710 microversion: 2.1 time: 0.181943 Sep 22 13:13:51.394265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 335/616] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:51 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:51.723476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:51.724177 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:51.741895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.742544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:51.743475 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.747464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:51.954219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:51.954831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:51.972251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.974271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:51.976878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:51.979217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:52.071743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:52.083857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f82521dc-eb49-4150-9d68-c7734ea51bbf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.364148 Sep 22 13:13:52.096500 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 282/617] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:51 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:52.109083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:52.111034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:52.119753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:52.120205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:52.121128 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:52.121514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:52.147962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:52.158767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6751aa76-64d4-4640-9940-4f7646db1fc1 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060504 Sep 22 13:13:52.159360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 283/618] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:52 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:52.161761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:52.163492 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:52.165512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1950861d-a783-4ce3-8ba4-c47d9f45f9be tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.214357 Sep 22 13:13:52.167066 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 336/619] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:51 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:52.413237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:52.413677 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:52.423629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:52.425980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:52.428287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:52.428579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:52.637539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:52.661166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d17508ff-fc14-433b-b882-378c3ea67548 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1710 microversion: 2.1 time: 0.242935 Sep 22 13:13:52.682147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 284/620] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:52 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1710 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:53.108041 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:53.108840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:53.118514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.119789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.120581 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.121025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.173624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:53.177875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:53.182514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.183055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.184178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.184857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.230921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b1b1efa4-a91f-400b-bd58-9b32d2eba8a7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062737 Sep 22 13:13:53.240622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 285/621] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:53 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:53.245019 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:53.245939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:53.254278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.254895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.255863 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.256292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.308773 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:53.318872 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-039f0389-d15e-4fac-b448-965efd4ef306 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.215837 Sep 22 13:13:53.328369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 337/622] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:53 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:53.453734 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:53.472279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:53.474042 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:53.476396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b15ce18a-2cc2-40f4-a467-da6ef343dc91 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.239305 Sep 22 13:13:53.477613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 286/623] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:53 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:53.690067 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:53.695346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:53.704622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.705415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.706379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:53.707019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:53.847159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:53.858450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-91ea4503-6254-44ef-94d3-83283267aae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1714 microversion: 2.1 time: 0.172607 Sep 22 13:13:53.867500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 338/624] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:53 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1714 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:54.252677 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:54.254521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:54.272671 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.273135 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.273955 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.274394 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.337045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:54.338550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:54.347692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-918d4f93-15d5-4a4a-8f8a-4a73ae2dfcdd tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101156 Sep 22 13:13:54.348807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 287/625] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:54 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:54.358192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.358833 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.359737 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.360699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.507003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:54.517108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:54.535101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:54.544482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6e0b38cc-0e4b-484d-a237-15941c704c47 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.212240 Sep 22 13:13:54.545112 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.550108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.553704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.553704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.555096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 339/626] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:54 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:13:54.560763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:54.561636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:54.567949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.568659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.569632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:54.570213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:54.722394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:54.732553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-35c9b703-3dc6-44bb-ab05-70c15b50fbb4 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1595 microversion: 2.1 time: 0.176053 Sep 22 13:13:54.733709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 340/627] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:54 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1595 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:54.761109 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:54.771233 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:54.773121 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:54.774763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-aacbde84-4bf3-42e1-9465-bb66f4cd3fe9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.278172 Sep 22 13:13:54.787520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 288/628] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:54 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:55.360336 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:55.360336 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:55.367001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.367695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:55.368766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.369436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:55.403920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9b3fbb1c-a311-4d90-bae8-8c1b719485fe tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048621 Sep 22 13:13:55.405047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 341/629] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:55 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:13:55.562138 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:55.563694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:55.569730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.570471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:55.571802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.573003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:55.742908 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:55.753629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6315f66d-5353-4e63-baca-cbf6fa75f972 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.195119 Sep 22 13:13:55.754579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 289/630] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:55 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:55.795139 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:55.795708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:55.801691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.802305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:55.803096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:55.803553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:56.036225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:56.046125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:56.047866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:56.049255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6a2148d7-8974-4a3e-a666-8f608295460c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.259085 Sep 22 13:13:56.063331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 342/631] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:55 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:56.417094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:56.418347 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:56.424364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:56.428695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:56.428695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:56.428695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:56.461038 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2fe99530-9a99-414a-bf77-21ab554ae53d tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049066 Sep 22 13:13:56.461867 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 290/632] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:13:56 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:13:56.772815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:56.775888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:56.790251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:56.792201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:56.793281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:56.793801 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:57.070041 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:57.070710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:57.077000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:57.082195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:57.082195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:57.082195 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:57.127017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:57.148790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c708c359-18f7-4f34-954a-7b9bcf17fba8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.381081 Sep 22 13:13:57.151535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 343/633] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:56 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:57.335375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:57.346484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:57.348487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:57.349994 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e9f153cb-081d-470c-992a-fbd179b4ece4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1752 microversion: 2.20 time: 0.283759 Sep 22 13:13:57.351156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 291/634] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:57 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1752 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:13:57.946359 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-4ee9385a-1eee-4541-894b-0dd0e7d9d819 req-0c30ecd3-3cd7-4788-ae5e-163effcb9764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:13:57.948207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:13:57.948207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:13:57.957507 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4ee9385a-1eee-4541-894b-0dd0e7d9d819 req-0c30ecd3-3cd7-4788-ae5e-163effcb9764 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:57.958252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4ee9385a-1eee-4541-894b-0dd0e7d9d819 req-0c30ecd3-3cd7-4788-ae5e-163effcb9764 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:57.971922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-4ee9385a-1eee-4541-894b-0dd0e7d9d819 req-0c30ecd3-3cd7-4788-ae5e-163effcb9764 service nova] Creating event network-changed:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:13:57.978557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-4ee9385a-1eee-4541-894b-0dd0e7d9d819 req-0c30ecd3-3cd7-4788-ae5e-163effcb9764 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037641 Sep 22 13:13:57.983936 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 344/635] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:13:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:13:58.170675 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:58.172054 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:58.180071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.180530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.182024 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.182477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.371852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:58.372948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:58.385350 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.385820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.386649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.387143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.553892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:58.570557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-05f4eca6-dfc2-4a8d-a916-e10bb7019161 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.399226 Sep 22 13:13:58.570557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 292/636] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:58 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:58.581845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:58.582172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:58.623288 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.623885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.624706 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:58.625174 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:58.719233 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:58.732442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:58.736079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:58.736743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7a917358-278a-4474-8f3e-ea395c502d3a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.369265 Sep 22 13:13:58.737735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 345/637] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:58 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:13:58.747630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:13:59.121107 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e5d66869-0996-43ea-9cc1-5b84a1255eba tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 204 len: 0 microversion: 2.1 time: 0.548016 Sep 22 13:13:59.125539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 293/638] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:13:58 2021] DELETE /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:13:59.132586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:59.133614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:59.143098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.145060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.145506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.146201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.504493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:59.513698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-34a77b5a-50bb-4dce-95f8-3a12ef1c0aa9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.385692 Sep 22 13:13:59.514730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 346/639] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:59 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:59.590509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:59.591199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:59.610012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.610910 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.611729 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.624405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.764984 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:13:59.766339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:13:59.775511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.776461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.778066 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:13:59.779152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:13:59.867308 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:13:59.889865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8f4b0b28-6d47-42cd-9bd5-751859f0f2e5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.299887 Sep 22 13:13:59.889865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 294/640] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:13:59 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:13:59.999365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:00.010706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:00.012856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:00.014386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9570bc8c-6733-46ac-8455-b4a574acdb96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.262136 Sep 22 13:14:00.016364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 347/641] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:13:59 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:00.538219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:00.543916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:00.563820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:00.564395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:00.571033 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:00.571033 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:00.725090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:00.734447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-296a45ad-a906-4e3b-9354-32950456bbf5 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.203993 Sep 22 13:14:00.735035 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 295/642] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:00 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:00.905339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:00.907252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:00.915065 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:00.916578 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:00.917915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:00.918516 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:01.036870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:01.037985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:01.047721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:01.048469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:01.049448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:01.050087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:01.242606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:01.255458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:01.255877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:01.258115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:01.260476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ed6f0a47-e548-4c84-b1f0-f7b87524f622 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.228648 Sep 22 13:14:01.261323 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 296/643] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:01 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:01.307080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d9d81bcd-c247-4579-96c6-b10b6ec09c00 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.407069 Sep 22 13:14:01.325415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 348/644] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:00 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:01.761624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:01.761624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:01.766902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:01.767549 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:01.768489 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:01.769407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:01.911703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:01.920167 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5d5769bf-7d2e-420a-a70d-c6ca3c784895 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.170939 Sep 22 13:14:01.921666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 297/645] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:01 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:02.239502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1738173678"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:02.240106 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:02.247046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.247878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.248974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.249598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.296334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:02.296985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:02.305328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.306889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.307982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.308660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.433123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.network.security_group_api [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Adding security group af77cbcc-034c-4fea-b39e-7d03255ba961 to port 198d6688-72fa-45fc-bcd9-c314e7fa6b0e Sep 22 13:14:02.504911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:02.518746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:02.523005 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:02.527673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dc2b585d-099f-42f3-9143-e15ade521e3b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.235241 Sep 22 13:14:02.529137 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 298/646] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:02 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:02.537513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:02.543283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:02.564737 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.565643 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.566820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.567575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.819473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:02.839085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d23789d2-109c-4af3-ad89-959d9e790867 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.305254 Sep 22 13:14:02.840304 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 299/647] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:02 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:02.938198 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:02.939234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:02.946073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.947467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:02.948507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:02.949150 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.129522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:03.146149 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7ca1d378-b7c3-4644-a764-89145a560986 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.211290 Sep 22 13:14:03.148018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 300/648] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:02 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:03.258693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d03558fc-dae6-4db9-a1fa-1498243d3d32 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action" status: 202 len: 0 microversion: 2.1 time: 1.022788 Sep 22 13:14:03.259304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 349/649] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:14:02 2021] POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:14:03.269119 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:03.270223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:03.281360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-2158d94b-ff0e-4ca5-b061-8625cdf69bb7 req-bcc993ee-ec42-43ff-b48d-78bee1bd368b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:03.286686 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:03.286686 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:03.294185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.294911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.295990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.300166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.315547 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2158d94b-ff0e-4ca5-b061-8625cdf69bb7 req-bcc993ee-ec42-43ff-b48d-78bee1bd368b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.323766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-2158d94b-ff0e-4ca5-b061-8625cdf69bb7 req-bcc993ee-ec42-43ff-b48d-78bee1bd368b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.352094 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-2158d94b-ff0e-4ca5-b061-8625cdf69bb7 req-bcc993ee-ec42-43ff-b48d-78bee1bd368b service nova] Creating event network-changed:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:14:03.358706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-2158d94b-ff0e-4ca5-b061-8625cdf69bb7 req-bcc993ee-ec42-43ff-b48d-78bee1bd368b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085742 Sep 22 13:14:03.360203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 350/650] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:03.527295 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:03.538295 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2ad9e22f-2741-4c53-aec1-2eff9e330968 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1761 microversion: 2.1 time: 0.273804 Sep 22 13:14:03.539353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 301/651] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:03 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1761 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:03.547327 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:03.548399 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:03.571578 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.572418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.573433 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.574057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.729263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:03.764877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:03.769849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:03.773918 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c0c7f032-e555-4a11-bfa0-236ca75804ee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.230258 Sep 22 13:14:03.790747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 351/652] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:03 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:03.866236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:03.867770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:03.875090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.876039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:03.877092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:03.877748 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:04.091220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:04.103893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dda32270-e111-42f5-b9b1-ab6471102edf tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.241576 Sep 22 13:14:04.114129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 302/653] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:03 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:04.165535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:04.166521 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:04.172569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:04.173088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:04.173862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:04.174460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:04.372442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:04.381309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-80bce282-23bd-4be8-88b6-aa653d984c88 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.220539 Sep 22 13:14:04.389593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 352/654] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:04 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:04.796569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:04.797369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:04.803358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:04.803857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:04.804768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:04.805265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:04.941579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:04.952267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:04.953800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:04.955075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b777172f-65ab-4ca7-8c07-6df187f95996 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.162261 Sep 22 13:14:04.955631 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 303/655] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:04 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:05.122375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:05.122375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:05.128832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.129360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:05.130239 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.130741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:05.254483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:05.262406 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4a3735d4-cf72-4062-a753-bc8f72a05127 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.145293 Sep 22 13:14:05.262982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 353/656] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:05 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:05.398895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:05.399825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:05.407299 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.407810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:05.408673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.409182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:05.617357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:05.626618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c40d6cec-c9e1-4439-9217-d94d8016590c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.232071 Sep 22 13:14:05.632960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 304/657] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:05 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:05.976488 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:05.977092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:05.983620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.984069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:05.984838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:05.985267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:06.125424 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:06.134487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:06.136101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:06.137290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-42c93809-ad2d-4378-8911-2caaf679d335 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.164608 Sep 22 13:14:06.137856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 354/658] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:05 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:06.279273 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:06.279927 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:06.286462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:06.286956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:06.287714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:06.288283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:06.429981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:06.440840 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-16387333-aca2-4612-86f3-bafd6558ab38 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.165015 Sep 22 13:14:06.451977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 305/659] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:06 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:06.648926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:06.649696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:06.656108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:06.656548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:06.657321 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:06.657742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:07.045671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:07.054653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e57646e2-81ae-4fe9-89aa-953b7e8da53f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.409485 Sep 22 13:14:07.061287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 355/660] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:06 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:07.197847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:07.198443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:07.205425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:07.205868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:07.206649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:07.207074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:07.354950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:07.364308 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:07.366510 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:07.368392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ec1da73e-44ca-45bf-b463-e2e6dc7ff29d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.175223 Sep 22 13:14:07.372612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 306/661] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:07 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:07.458331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:07.459111 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:07.466286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:07.466739 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:07.467576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:07.468013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:07.668645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:07.676914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ede6de56-7852-4d78-8588-081d762b8520 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.222427 Sep 22 13:14:07.677502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 356/662] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:07 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:08.073798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:08.074415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:08.080525 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.080967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.081745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.082171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.232404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:08.240225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4919c5f3-33e8-4dcd-b880-a56275ce31e7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.170879 Sep 22 13:14:08.240798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 307/663] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:08 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:08.391530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:08.392279 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:08.398151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.398836 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.400219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.400867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.565396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:08.575517 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:08.577187 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:08.578441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5be6a249-9aab-4e44-b6d5-0d8e4b9cb97d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.191163 Sep 22 13:14:08.579101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 357/664] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:08 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:08.694353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:08.695021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:08.710872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.711370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.712317 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:08.712828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:08.909590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:08.925109 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-461cb85c-3629-4b04-8efc-3033891f1bac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.234500 Sep 22 13:14:08.931615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 308/665] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:08 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:09.257908 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:09.258512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:09.264830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.272334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:09.272334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.272334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:09.414617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:09.422523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bfb03b37-083e-4e8c-b3f7-5c1e0e0b6f80 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.168484 Sep 22 13:14:09.423360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 358/666] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:09 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:09.597853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:09.602010 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:09.604855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.605517 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:09.606517 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.606950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:09.787978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:09.802058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:09.803909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:09.806323 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7e762a70-f2cf-41f5-8442-5026c34c4a19 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.213465 Sep 22 13:14:09.806940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 309/667] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:09 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:09.943771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:09.944400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:09.952524 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.952969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:09.953839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:09.954270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:10.126052 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:10.135793 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1b632380-ecb8-4f93-bd92-7f2f4bf12fac tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.196168 Sep 22 13:14:10.137302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 359/668] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:09 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:10.439415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:10.440214 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:10.452152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:10.452152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:10.453798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:10.455006 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:10.629683 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:10.639710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cd4bb757-e26f-4cf0-838a-ac9bf4c6f43c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.204101 Sep 22 13:14:10.651617 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 310/669] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:10 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:10.826515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:10.827247 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:10.833373 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:10.833896 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:10.834656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:10.835087 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:10.964830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:10.973619 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:10.975493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:10.977926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f7bcc598-4b4f-4db4-b31e-8b47e6f950f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.155106 Sep 22 13:14:10.980464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 360/670] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:10 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:11.154633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:11.156031 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:11.169845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:11.170286 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:11.172328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:11.172328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:11.340722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:11.355839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-831ed988-ade0-4c46-826c-41e63d021f23 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.204202 Sep 22 13:14:11.357742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 311/671] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:11 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:11.658622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:11.659726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:11.671815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:11.675984 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:11.677413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:11.678838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:11.853440 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:11.862799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f161f470-c52c-4df9-94ba-3a148c470972 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.208362 Sep 22 13:14:11.863680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 361/672] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:11 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:12.009258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:12.010356 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:12.021332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.023017 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:12.024660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.025836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:12.238223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:12.252070 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:12.254521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:12.258832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2323c1df-bdbe-44aa-914e-f65c461dba06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.253234 Sep 22 13:14:12.262466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 312/673] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:12 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:12.375606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:12.376259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:12.382460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.387478 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:12.387478 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.387478 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:12.550187 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:12.559989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-43fc20db-03ac-441b-810b-1ea74fb2ab33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.188373 Sep 22 13:14:12.564323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 362/674] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:12 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:12.880581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:12.881178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:12.888365 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.888805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:12.891548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:12.891548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:13.024520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:13.032188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-58978c1c-4ba7-45fb-a8c7-832704886587 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.155555 Sep 22 13:14:13.032739 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 313/675] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:12 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:13.294332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:13.295040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:13.301631 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:13.302124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:13.303039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:13.303605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:13.434267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:13.442969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:13.444566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:13.445823 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a9676e70-b2f9-4f92-8a19-220270f3b9f6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.155270 Sep 22 13:14:13.446388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 363/676] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:13 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:13.577524 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:13.578150 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:13.585001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:13.585477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:13.586304 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:13.587248 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:13.783771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:13.794124 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4118eb73-ae5b-4121-bb1e-38ef772cff53 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.220370 Sep 22 13:14:13.799885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 314/677] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:13 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:14.050049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:14.050789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:14.057160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.057605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.058380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.058817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.215113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:14.227933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b36878f5-db40-4071-8433-86a4b0f16b11 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1513 microversion: 2.1 time: 0.181572 Sep 22 13:14:14.228618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 364/678] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:14 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:14.261283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-785341086", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:14.327413 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] validate_networks() for None {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:14:14.464366 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:14.465633 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:14.473993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.474442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.475268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.475731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.717939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:14.727606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:14.729593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:14.730797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-18f9343f-f116-41ee-a87a-90ca6751a656 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.270569 Sep 22 13:14:14.731371 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 365/679] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:14 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:14.811589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:14.813002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:14.820421 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.821240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.822116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.822662 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.949918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:14:14.950476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:14:14.950818 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:14:14.951218 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:14:14.951658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:14:14.963205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.963629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.964411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:14.964841 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:14.984007 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Getting quotas for project d328c1569ef144f9a18c973a5f511eda. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:14:14.988328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Getting quotas for user db7b02ec1e39454a8efc0b774cd21a73 and project d328c1569ef144f9a18c973a5f511eda. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:14:14.996981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.001933 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:14:15.004990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:14:15.006406 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b08cc2a8-4986-44c3-a9ec-b1152861c596 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.197797 Sep 22 13:14:15.007356 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 366/680] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:14 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:15.085369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-5c9ff26a-0aaa-4456-a3af-3eb21a443c2b req-75724e5d-7ab4-4248-b3ca-0b61af355cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c9c788-beff-4411-a824-3363acb27590", "name": "network-vif-deleted", "tag": "f332588d-756b-4e7c-abe2-71a2c5b790a6"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:15.088138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:15.088138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:15.096644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-5c9ff26a-0aaa-4456-a3af-3eb21a443c2b req-75724e5d-7ab4-4248-b3ca-0b61af355cad service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:15.097309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-5c9ff26a-0aaa-4456-a3af-3eb21a443c2b req-75724e5d-7ab4-4248-b3ca-0b61af355cad service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:15.111951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-5c9ff26a-0aaa-4456-a3af-3eb21a443c2b req-75724e5d-7ab4-4248-b3ca-0b61af355cad service nova] Creating event network-vif-deleted:f332588d-756b-4e7c-abe2-71a2c5b790a6 for instance 44c9c788-beff-4411-a824-3363acb27590 on hv-cinder-81000 Sep 22 13:14:15.122344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-5c9ff26a-0aaa-4456-a3af-3eb21a443c2b req-75724e5d-7ab4-4248-b3ca-0b61af355cad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040791 Sep 22 13:14:15.123829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 367/681] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:14:15.142683 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9236a8c1-e78b-4909-8846-f98f36903a74 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885715 Sep 22 13:14:15.143871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 315/682] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:14:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:14:15.155185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-10f033d1-0be8-469f-9bc9-051d552ad7c9 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:15.156391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-10f033d1-0be8-469f-9bc9-051d552ad7c9 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:15.238714 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-10f033d1-0be8-469f-9bc9-051d552ad7c9 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.246721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:15.250953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:15.251105 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-10f033d1-0be8-469f-9bc9-051d552ad7c9 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1214 microversion: 2.1 time: 0.096905 Sep 22 13:14:15.251105 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 368/683] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:15 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:15.258729 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:15.259176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:15.259985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:15.260600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:15.343002 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.351220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5f582f04-f3ca-4762-a890-62231ae97ea7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1471 microversion: 2.1 time: 0.109004 Sep 22 13:14:15.352658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 316/684] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:15 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:15.748931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:15.749670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:15.756390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:15.756832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:15.757648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:15.758085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:15.886928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.895092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.896617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:15.897774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5cdf7bd3-0a92-4637-8008-ba762dcdbdee tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.152646 Sep 22 13:14:15.898939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 369/685] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:15 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:16.024492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:16.025126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:16.032605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.033049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.033965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.034522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.171150 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:16.178892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ec7447c5-b1f9-4c88-90c9-c2b4261c7ef7 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1567 microversion: 2.1 time: 0.159052 Sep 22 13:14:16.179514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 317/686] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:16 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:16.266135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0ebb4ac7-123c-4f87-a346-53c05b3e4a47 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:16.267576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0ebb4ac7-123c-4f87-a346-53c05b3e4a47 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:16.338782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0ebb4ac7-123c-4f87-a346-53c05b3e4a47 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:16.345993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0ebb4ac7-123c-4f87-a346-53c05b3e4a47 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1214 microversion: 2.1 time: 0.083653 Sep 22 13:14:16.357461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 370/687] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:16 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:16.369405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:16.370154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:16.377920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.378680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.379476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.380091 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.420134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.420581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.421062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 44c9c788-beff-4411-a824-3363acb27590 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:16.468430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:16.477548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-20459a57-ee8f-4c07-a70e-c45afc9a3cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 200 len: 1307 microversion: 2.1 time: 0.112592 Sep 22 13:14:16.478540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 318/688] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:16 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:16.920656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:16.921299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:16.927456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.928151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:16.929172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:16.930039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.091681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:17.100236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:17.104991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:17.104991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9ccb1dd4-c75c-4216-840f-dc9b2bb4cdc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.187222 Sep 22 13:14:17.104991 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 371/689] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:16 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:17.196426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:17.197018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.202991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.203445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.204215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.204642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.352127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:17.364832 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7edf5097-ee9a-452e-8cab-dc2e8c43950a tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:17.365236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9e924a45-1203-459c-8b5b-76761194b8ad tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1547 microversion: 2.1 time: 0.172975 Sep 22 13:14:17.366105 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 319/690] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:17 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:17.366233 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7edf5097-ee9a-452e-8cab-dc2e8c43950a tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.385270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:17.385942 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.392503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.392941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.393776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.394206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.432351 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7edf5097-ee9a-452e-8cab-dc2e8c43950a tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:17.441422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7edf5097-ee9a-452e-8cab-dc2e8c43950a tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1214 microversion: 2.1 time: 0.080299 Sep 22 13:14:17.455575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 372/691] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:17 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:17.511905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:17.512533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 44c9c788-beff-4411-a824-3363acb27590] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.519310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.520675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.525256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.525256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.539590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] HTTP exception thrown: Cannot 'detach_volume' instance 62dd1478-ba12-4a46-8c78-62519c2c512b while it is in vm_state rescued Sep 22 13:14:17.540190 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Returning 409 to user: Cannot 'detach_volume' instance 62dd1478-ba12-4a46-8c78-62519c2c512b while it is in vm_state rescued {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:17.541034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-55b1caec-96e6-43ba-be19-2045fdd4257e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments/46fa3ce6-95f9-48f5-89c3-6cc16c5aeab1" status: 409 len: 152 microversion: 2.1 time: 0.161296 Sep 22 13:14:17.541586 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 320/692] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:14:17 2021] DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments/46fa3ce6-95f9-48f5-89c3-6cc16c5aeab1 => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 22 13:14:17.544129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Instance 44c9c788-beff-4411-a824-3363acb27590 could not be found. Sep 22 13:14:17.544972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 404 to user: Instance 44c9c788-beff-4411-a824-3363acb27590 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:17.545808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5a7570c9-d4f0-43b3-86a0-a5e0bd66eaf9 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590" status: 404 len: 111 microversion: 2.1 time: 0.051831 Sep 22 13:14:17.547509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 373/693] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:17 2021] GET /compute/v2.1/servers/44c9c788-beff-4411-a824-3363acb27590 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:14:17.550610 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:17.551197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.558861 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.559373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.561102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.561102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.901559 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f3e129af-1002-49f5-a246-29753095c020 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action" status: 202 len: 0 microversion: 2.1 time: 0.354944 Sep 22 13:14:17.902355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 321/694] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:14:17 2021] POST /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:14:17.911675 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:17.912295 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:17.920038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.920489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:17.921335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:17.922014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.074553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:18.104880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-307d94fa-0eea-4ae7-a287-e0f41f66fa98 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1555 microversion: 2.1 time: 0.195794 Sep 22 13:14:18.104880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 374/695] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:17 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:18.123240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:18.124054 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:18.130569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.139339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.139339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.139339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.369216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:18.379546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:18.381271 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:18.383104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f37efe5d-0042-4650-bc90-fb28cb0a65e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.263485 Sep 22 13:14:18.383994 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 322/696] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:18 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:18.467579 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:18.468203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:18.474240 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.474702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.475466 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.476143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.548914 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:18.556372 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c0b7a463-2c79-45c3-bd76-b6c59908e18d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1266 microversion: 2.1 time: 0.093103 Sep 22 13:14:18.557113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 375/697] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:18 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:18.906971 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:18.912557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:18.915014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.915484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.916265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:18.916688 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:18.941917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:19.124743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:19.126511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:19.147346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.147346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.147346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.147346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.287837 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bd873a09-d392-45b9-82e3-ea4a21a7eb4f tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 204 len: 0 microversion: 2.1 time: 0.384578 Sep 22 13:14:19.289334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 323/698] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:18 2021] DELETE /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 13:14:19.301866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:19.302575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:19.309484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.309924 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.310743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.311204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.365391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.375280 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b8d59b26-4516-4534-ae90-1b7a4d7e4fe3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1555 microversion: 2.1 time: 0.256558 Sep 22 13:14:19.376285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 376/699] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:19 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:19.402492 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:19.403327 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:19.409515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.414634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.414634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.414634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.486271 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.506077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0250b1a6-8aff-4dd8-b662-839ae87925f8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1514 microversion: 2.1 time: 0.208447 Sep 22 13:14:19.515753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 324/700] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:19 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:19.559242 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.567636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.569699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.571118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-48beb231-efc9-44d6-9587-00347fa5aa1a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.173250 Sep 22 13:14:19.571718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 377/701] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:19 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:19.577846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:19.578465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:19.589666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.590314 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.591257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:19.591764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:19.656546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:19.664549 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-efbfa230-8f90-468a-805e-91ce412508eb tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1272 microversion: 2.1 time: 0.094043 Sep 22 13:14:19.665122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 325/702] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:19 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:20.392750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:20.393522 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:20.400475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.400992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.401961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.402477 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.522240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:20.524098 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:20.530388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.536572 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.537018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.537793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.538283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.538606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7fb370d1-44ee-46bc-b315-a8971fd3bb2b tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1555 microversion: 2.1 time: 0.149423 Sep 22 13:14:20.539266 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 378/703] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:20 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:20.588606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:20.589274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:20.595631 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.596248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.597092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.599477 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.729192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.737956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.739801 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.741153 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2dc07c45-163e-4501-905e-57207c4bda55 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.156389 Sep 22 13:14:20.742669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 379/704] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:20 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:20.752566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:20.752746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.753394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:20.761747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1f20febe-b957-4b85-bde2-78b3a35e505b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1514 microversion: 2.1 time: 0.243330 Sep 22 13:14:20.766268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.766268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.766626 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 326/705] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:20 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:20.766724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:20.766724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:20.897294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:20.905021 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-51730769-f874-4ced-b6d0-f12b3228fc7c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.159849 Sep 22 13:14:20.905593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 380/706] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:20 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:21.271712 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-9d558f32-c88b-49e9-bc66-94b2971c587f req-56c8b969-b13b-4bca-9644-9e18a818c81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc55bec9-bad8-4cfb-8cde-ed61e8c97a24", "tag": "2b15b73b-052e-4534-8652-b8314f4f4eef"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:21.274316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:21.274316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:14:21.285153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-9d558f32-c88b-49e9-bc66-94b2971c587f req-56c8b969-b13b-4bca-9644-9e18a818c81f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.291857 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-9d558f32-c88b-49e9-bc66-94b2971c587f req-56c8b969-b13b-4bca-9644-9e18a818c81f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.301089 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-9d558f32-c88b-49e9-bc66-94b2971c587f req-56c8b969-b13b-4bca-9644-9e18a818c81f service nova] Creating event network-changed:2b15b73b-052e-4534-8652-b8314f4f4eef for instance bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 on hv-cinder-81000 Sep 22 13:14:21.305992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-9d558f32-c88b-49e9-bc66-94b2971c587f req-56c8b969-b13b-4bca-9644-9e18a818c81f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037984 Sep 22 13:14:21.306615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 327/707] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:21.556451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:21.563689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:21.563689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.563689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.564288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.564721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.761527 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:21.762225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:21.768544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.769913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.769913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.770274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.787192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:21.801050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4bb0367f-13b7-42ad-8db2-9c99ea793ed4 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1561 microversion: 2.1 time: 0.248616 Sep 22 13:14:21.802236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 381/708] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:21 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1561 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:21.821448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:21.826614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:21.847540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.848337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.849333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.849955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.968837 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:21.977565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:21.979054 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:21.980428 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a40cfb33-5e1d-4500-820f-494c88adb23b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.223944 Sep 22 13:14:21.980985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 328/709] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:21 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:21.985606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:21.986357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:21.993882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.994416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:21.995261 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:21.995783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.046405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:22.054719 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-67b68c8f-a9c2-4ecd-a1a2-1f3849e9781b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1514 microversion: 2.1 time: 0.240461 Sep 22 13:14:22.058544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 382/710] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:21 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:22.062327 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:22.062935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:22.068699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:22.069225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.071056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:22.071056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.102100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lazy-loading 'services' on Instance uuid 62dd1478-ba12-4a46-8c78-62519c2c512b {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:22.332575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:22.341454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d70d3c5c-86b0-408e-9d23-10e3e905504e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.284356 Sep 22 13:14:22.342583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 383/711] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:22 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:22.359033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-e1a7b767-1076-4b98-b468-516b2f8ad681 req-1afd8cbc-7ee0-4610-a2dd-3636e2c91b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc54643-cc02-4783-b19d-488a79688fba", "name": "network-vif-deleted", "tag": "61212e42-5473-4004-80a0-373d6f55f8f2"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:22.359033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:22.359033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:22.365549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e1a7b767-1076-4b98-b468-516b2f8ad681 req-1afd8cbc-7ee0-4610-a2dd-3636e2c91b6f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:22.366225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e1a7b767-1076-4b98-b468-516b2f8ad681 req-1afd8cbc-7ee0-4610-a2dd-3636e2c91b6f service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.387311 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-e1a7b767-1076-4b98-b468-516b2f8ad681 req-1afd8cbc-7ee0-4610-a2dd-3636e2c91b6f service nova] Creating event network-vif-deleted:61212e42-5473-4004-80a0-373d6f55f8f2 for instance 1dc54643-cc02-4783-b19d-488a79688fba on hv-cinder-81000 Sep 22 13:14:22.391010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-e1a7b767-1076-4b98-b468-516b2f8ad681 req-1afd8cbc-7ee0-4610-a2dd-3636e2c91b6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037081 Sep 22 13:14:22.391689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 384/712] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:22.492932 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c4266e04-e353-4302-bfac-8ce72dd98315 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments/46fa3ce6-95f9-48f5-89c3-6cc16c5aeab1" status: 202 len: 0 microversion: 2.1 time: 0.509574 Sep 22 13:14:22.493534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 329/713] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:14:21 2021] DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments/46fa3ce6-95f9-48f5-89c3-6cc16c5aeab1 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:14:22.502757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:22.503829 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:22.511272 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:22.511794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.516458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:22.516994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:22.548189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bdfcbdca-2daf-45ba-acc4-95c93652014f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049912 Sep 22 13:14:22.548830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 385/714] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:14:22 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:22.999306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:23.000234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:23.006229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.006679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.007702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.008216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.072291 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:23.072905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:23.078743 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.079202 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.080006 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.080624 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.115049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.115376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.115848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 1dc54643-cc02-4783-b19d-488a79688fba {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:23.140435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:23.149855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:23.151769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:23.153031 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-afed3e5b-4db0-488d-9082-bfbfa1022892 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.157974 Sep 22 13:14:23.165387 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 330/715] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:22 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:23.166778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:23.174863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1dbbace5-f0aa-42dd-966d-7206fc7f9a35 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 200 len: 1308 microversion: 2.1 time: 0.106310 Sep 22 13:14:23.175850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 386/716] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:23 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:23.360079 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:23.360685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:23.367353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.367754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.368580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.369025 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.524448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:23.541695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-11d06ddf-158b-4fa7-9ed5-62b24230ff1e tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.184262 Sep 22 13:14:23.542396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 331/717] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:23 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:23.560045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:23.560953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:23.566602 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.567044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.567834 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:23.568262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:23.603194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aed1093b-e618-4230-bd86-4792d20e85b9 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046725 Sep 22 13:14:23.604628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 387/718] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:14:23 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:24.172553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.173184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.179608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.180057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.180856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.181282 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.192232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.192919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 1dc54643-cc02-4783-b19d-488a79688fba] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.201359 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.201813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.202663 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.203095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.217862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Instance 1dc54643-cc02-4783-b19d-488a79688fba could not be found. Sep 22 13:14:24.218569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 404 to user: Instance 1dc54643-cc02-4783-b19d-488a79688fba could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:24.219398 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b145bd7f-9e84-4595-9cde-ddcbc3ec236a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba" status: 404 len: 111 microversion: 2.1 time: 0.031256 Sep 22 13:14:24.220060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 388/719] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:24 2021] GET /compute/v2.1/servers/1dc54643-cc02-4783-b19d-488a79688fba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:14:24.228363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.228857 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.234756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.235201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.236008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.236442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.262815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:24.319035 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:24.328568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:24.330199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:24.331618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3baddcf1-d11b-4660-b0c5-489cd54fd5ff tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.162876 Sep 22 13:14:24.332208 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 332/720] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:24 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:24.525920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a813867f-8442-430e-b026-4e5160bebf55 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 204 len: 0 microversion: 2.1 time: 0.301307 Sep 22 13:14:24.526498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 389/721] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:24 2021] DELETE /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:14:24.537071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.537740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.545606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.546059 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.546838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.547270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.559970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.560815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.566862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.567328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.568596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.568596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.694166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:24.702865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a5ac8977-d95f-4b07-bf35-4668e71fffeb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1513 microversion: 2.1 time: 0.169647 Sep 22 13:14:24.703484 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 333/722] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:24 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:24.708552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:24.711502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:24.714939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:24.717007 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.717583 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.718443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:24.718944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:24.722429 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-02f52d53-cb7f-4fa6-8a13-2eceadaed111 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.166543 Sep 22 13:14:24.723060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 390/723] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:24 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:24.753579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2c30adcd-4a1a-4ad4-99ab-293bd15fefc8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048826 Sep 22 13:14:24.754129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 334/724] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:14:24 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:14:25.093801 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-870ee7a2-ba71-424e-b4e1-ab5d85d609b7 req-20dbd704-1c95-454e-8ca1-2a27a08fb5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "name": "network-vif-plugged", "status": "completed", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:25.096054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:25.096054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:25.104140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-870ee7a2-ba71-424e-b4e1-ab5d85d609b7 req-20dbd704-1c95-454e-8ca1-2a27a08fb5cf service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.104615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-870ee7a2-ba71-424e-b4e1-ab5d85d609b7 req-20dbd704-1c95-454e-8ca1-2a27a08fb5cf service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.115708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-870ee7a2-ba71-424e-b4e1-ab5d85d609b7 req-20dbd704-1c95-454e-8ca1-2a27a08fb5cf service nova] Creating event network-vif-plugged:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:14:25.121039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-870ee7a2-ba71-424e-b4e1-ab5d85d609b7 req-20dbd704-1c95-454e-8ca1-2a27a08fb5cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Sep 22 13:14:25.121696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 391/725] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:25.349999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:25.350592 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:25.356415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.356879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.357617 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.358039 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.480514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:25.488829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:25.490311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:25.491990 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-45c30171-2bb1-4198-bd7e-56a2384b9a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.145266 Sep 22 13:14:25.499290 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 335/726] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:25 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:25.727916 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:25.728667 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:25.734586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.735231 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.736182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.736769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.739947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:25.740776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:25.749306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.750337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.751481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:25.752092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:25.885133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:25.892695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e6d3a85b-bf87-4a34-91f0-734be8247dd4 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1513 microversion: 2.1 time: 0.168772 Sep 22 13:14:25.893285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 392/727] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:25 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:25.912547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:25.920409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a57f880f-d025-4eb3-a7ce-deba3db3187b tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.184394 Sep 22 13:14:25.920995 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 336/728] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:25 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:26.510480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:26.511080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:26.517366 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.517840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:26.518633 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.519068 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:26.644654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:26.654383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:26.655897 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:26.657059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cdb0b573-7213-401b-b23b-f257a0e7b59c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.150445 Sep 22 13:14:26.657622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 393/729] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:26 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:26.910019 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:26.910557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:26.916807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.917252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:26.918021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.918513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:26.938842 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:26.940467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:26.952340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.953118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:26.954418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:26.954933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.055274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.063163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5557189b-1ce8-4b1b-806f-66e8cdf18efb tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1513 microversion: 2.1 time: 0.156904 Sep 22 13:14:27.063978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 337/730] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:26 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:27.169227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.178649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2e8fd60d-8a0e-4180-9ea4-df9eb158d3c2 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.244439 Sep 22 13:14:27.179241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 394/731] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:26 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:27.391557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:27.392604 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:27.399678 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.400122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.406296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.406296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.434813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:27.665777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-81e8dc0c-cc68-4025-8ce6-1f1c8ff063cf req-a6f52c98-3433-478f-bd83-5d180a70465c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8369eb82-e777-4163-baea-b3cc2fa04b12", "name": "network-vif-deleted", "tag": "aaae317a-63a2-4d22-ad36-3ca9211cdcbb"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:27.671990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:27.671990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:27.686471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-81e8dc0c-cc68-4025-8ce6-1f1c8ff063cf req-a6f52c98-3433-478f-bd83-5d180a70465c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.687756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-81e8dc0c-cc68-4025-8ce6-1f1c8ff063cf req-a6f52c98-3433-478f-bd83-5d180a70465c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.724581 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-81e8dc0c-cc68-4025-8ce6-1f1c8ff063cf req-a6f52c98-3433-478f-bd83-5d180a70465c service nova] Creating event network-vif-deleted:aaae317a-63a2-4d22-ad36-3ca9211cdcbb for instance 8369eb82-e777-4163-baea-b3cc2fa04b12 on hv-cinder-81000 Sep 22 13:14:27.730881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-81e8dc0c-cc68-4025-8ce6-1f1c8ff063cf req-a6f52c98-3433-478f-bd83-5d180a70465c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074224 Sep 22 13:14:27.731621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 395/732] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:27.743110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:27.743110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:27.750162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.752176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.752176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.752176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.793802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-097c6b23-e41e-4189-b9eb-74254b1b6c90 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 204 len: 0 microversion: 2.1 time: 0.405543 Sep 22 13:14:27.795344 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 338/733] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:27 2021] DELETE /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:14:27.804692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:27.805645 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:27.812031 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.812750 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.813524 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:27.814108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:27.942260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.952880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.954394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.955856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52fb2c08-ec8b-422e-bd7e-1be6b9208785 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.222762 Sep 22 13:14:27.956918 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 396/734] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:27 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:27.958225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:27.966184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dc52a1c9-397b-4221-adc1-02f5904efc73 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1506 microversion: 2.1 time: 0.166278 Sep 22 13:14:27.966720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 339/735] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:27 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:28.082258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:28.083076 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:28.089637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.090087 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.090874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.091309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.124287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.124735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.125188 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 8369eb82-e777-4163-baea-b3cc2fa04b12 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:28.166701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:28.174334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a4041831-b40c-41b6-a858-3caabe947c4a tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 200 len: 1306 microversion: 2.1 time: 0.096117 Sep 22 13:14:28.174923 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 397/736] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:28 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:28.195762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:28.196309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:28.206315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.206862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.207831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.208752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.347698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:28.356460 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1482b199-9ff0-435e-8c8e-c790bd2a6fc7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.164867 Sep 22 13:14:28.357007 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 340/737] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:28 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:28.974401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:28.975645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:28.983028 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:28.984306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:28.990507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.990948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.995728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.996167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:28.996935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.997371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:28.997996 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.001007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.133901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:29.135568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:29.143298 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:29.144261 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-de8cfa4a-6acf-4121-8b15-eaef3ccc0373 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1506 microversion: 2.1 time: 0.164806 Sep 22 13:14:29.144821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:29.144963 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 341/738] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:28 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:29.146550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d434a844-2c3b-44bd-a603-b5e051bc5b53 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1808 microversion: 2.20 time: 0.176032 Sep 22 13:14:29.147278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 398/739] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:28 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:14:29.149579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-dfa5c064-bb47-4a10-b421-7f605c756b70 req-052c308c-d6e9-4c50-95ac-5ce2825f7e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc55bec9-bad8-4cfb-8cde-ed61e8c97a24", "name": "network-vif-plugged", "status": "completed", "tag": "2b15b73b-052e-4534-8652-b8314f4f4eef"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:29.151305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:29.151305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:14:29.158813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-dfa5c064-bb47-4a10-b421-7f605c756b70 req-052c308c-d6e9-4c50-95ac-5ce2825f7e8b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:29.159245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-dfa5c064-bb47-4a10-b421-7f605c756b70 req-052c308c-d6e9-4c50-95ac-5ce2825f7e8b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.171257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-dfa5c064-bb47-4a10-b421-7f605c756b70 req-052c308c-d6e9-4c50-95ac-5ce2825f7e8b service nova] Creating event network-vif-plugged:2b15b73b-052e-4534-8652-b8314f4f4eef for instance bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 on hv-cinder-81000 Sep 22 13:14:29.176598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-dfa5c064-bb47-4a10-b421-7f605c756b70 req-052c308c-d6e9-4c50-95ac-5ce2825f7e8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030643 Sep 22 13:14:29.177234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 342/740] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:29.192154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:29.198245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 8369eb82-e777-4163-baea-b3cc2fa04b12] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:29.205997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:29.206655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.207232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:29.207699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.228883 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Instance 8369eb82-e777-4163-baea-b3cc2fa04b12 could not be found. Sep 22 13:14:29.229400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 404 to user: Instance 8369eb82-e777-4163-baea-b3cc2fa04b12 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:29.230232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7813980a-fcea-49e8-8470-68ae7f269ac7 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12" status: 404 len: 111 microversion: 2.1 time: 0.041926 Sep 22 13:14:29.231103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 399/741] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:29 2021] GET /compute/v2.1/servers/8369eb82-e777-4163-baea-b3cc2fa04b12 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:14:29.373452 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:29.374145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:29.380146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:29.380652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.381366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:29.381797 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:29.506713 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:29.515820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ece16c29-47e3-4b81-a99a-845dcab60952 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.146240 Sep 22 13:14:29.516404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 343/742] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:29 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:30.160508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:30.161072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:30.167118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:30.167745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:30.167881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.168331 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.169110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.169610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.173552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.173991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.174761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.175367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.300798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:30.307730 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:30.309391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-17a5036b-d026-4e6c-ac14-915bf297f7ca tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1506 microversion: 2.1 time: 0.152699 Sep 22 13:14:30.310013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 400/743] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:30 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:30.317612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:30.319096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:30.321004 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-726b2d5f-fdae-4465-be4e-8a1df83893c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1795 microversion: 2.20 time: 0.157770 Sep 22 13:14:30.321550 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 344/744] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:14:30 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:14:30.533487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:30.534120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:30.540048 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.540495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.541258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.541689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.578334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:30.578859 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:30.586529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.586973 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.587793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.588270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.614539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:30.665400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:30.672620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-73e0ead9-42c2-4904-8b73-1052b4eb1c88 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1314 microversion: 2.1 time: 0.142795 Sep 22 13:14:30.673183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 401/745] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:30 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:30.912303 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-64849a77-45a7-4a39-a18d-7d99aca85fcf tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 204 len: 0 microversion: 2.1 time: 0.337286 Sep 22 13:14:30.912923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 345/746] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:30 2021] DELETE /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 13:14:30.921270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:30.921937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:30.928247 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.928700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:30.930748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:30.931238 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.062276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:31.069733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9318d06e-8c0a-4c8b-b0ff-04537b234a9b tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1514 microversion: 2.1 time: 0.152298 Sep 22 13:14:31.070349 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 402/747] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:30 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:31.327389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:31.328063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:31.333821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.334259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.335016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.335779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.462158 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:31.469675 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6f3349a2-ec2b-4cfd-b720-ca0cef0683f1 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1506 microversion: 2.1 time: 0.146638 Sep 22 13:14:31.470248 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 346/748] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:31 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:31.691183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:31.691585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:31.698036 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.698482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.702269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.702269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.917964 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:31.926564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-046bc33c-b140-450c-a117-1427a105bbb7 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1463 microversion: 2.1 time: 0.239220 Sep 22 13:14:31.927501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 403/749] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:31 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:31.967694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:31.968196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:31.974000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.974445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:31.975215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:31.975852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.000965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:32.088030 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:32.088690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:32.094906 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.095342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.096142 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.096569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.302793 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:32.321169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dba8d1ca-1547-4b72-a24e-2c397a895cf2 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1514 microversion: 2.1 time: 0.238120 Sep 22 13:14:32.322353 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 404/750] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:32 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:32.341483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-99185aea-cd91-47cf-8bd9-d37891529560 req-e6883a73-957e-41de-920e-a306c408dd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51372312-678a-4ec5-8407-7ef186a53479", "name": "network-vif-deleted", "tag": "77b84daf-d8c2-48ad-9cf3-ea50800c0b2d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:32.341483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:32.341483 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:32.347001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-99185aea-cd91-47cf-8bd9-d37891529560 req-e6883a73-957e-41de-920e-a306c408dd66 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.347705 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-99185aea-cd91-47cf-8bd9-d37891529560 req-e6883a73-957e-41de-920e-a306c408dd66 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.360058 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-99185aea-cd91-47cf-8bd9-d37891529560 req-e6883a73-957e-41de-920e-a306c408dd66 service nova] Creating event network-vif-deleted:77b84daf-d8c2-48ad-9cf3-ea50800c0b2d for instance 51372312-678a-4ec5-8407-7ef186a53479 on hv-cinder-81000 Sep 22 13:14:32.365171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-99185aea-cd91-47cf-8bd9-d37891529560 req-e6883a73-957e-41de-920e-a306c408dd66 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Sep 22 13:14:32.365979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 405/751] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:32.426573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f6fb8be0-22f5-4156-9ca6-933cb5e33d9c tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 204 len: 0 microversion: 2.1 time: 0.463798 Sep 22 13:14:32.428246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 347/752] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:31 2021] DELETE /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:14:32.436695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:32.437387 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:32.443258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.443791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.444562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.446115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.488934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:32.489773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:32.497018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.497476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.498259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:32.498695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:32.565634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:32.573911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-15f17207-5076-4095-88c1-d9e095f3d5d5 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 200 len: 1292 microversion: 2.1 time: 0.089727 Sep 22 13:14:32.574431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 348/753] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:32 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:32.579678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:32.589100 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2d09914f-c069-4117-aad8-f3109084af3d tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1469 microversion: 2.1 time: 0.156332 Sep 22 13:14:32.589684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 406/754] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:32 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:33.340080 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:33.340621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:33.346479 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.346912 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.347706 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.348134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.485921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:33.493829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a0534c72-b5b6-4ca5-abe5-b74d0887ff28 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1514 microversion: 2.1 time: 0.158263 Sep 22 13:14:33.494757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 349/755] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:33 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:33.590809 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:33.591351 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 51372312-678a-4ec5-8407-7ef186a53479] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:33.597341 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.598075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.599656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.603267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.609082 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:33.609958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:33.622067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.622866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.624208 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.624651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.638422 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] HTTP exception thrown: Instance 51372312-678a-4ec5-8407-7ef186a53479 could not be found. Sep 22 13:14:33.639017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Returning 404 to user: Instance 51372312-678a-4ec5-8407-7ef186a53479 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:33.639867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-12b526f9-a97e-4408-a11b-d418aed9c9fa tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479" status: 404 len: 111 microversion: 2.1 time: 0.052842 Sep 22 13:14:33.640530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 407/756] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:33 2021] GET /compute/v2.1/servers/51372312-678a-4ec5-8407-7ef186a53479 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:14:33.658122 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:33.658803 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:33.665866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.666672 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.672196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.672196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.704050 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:14:33.792136 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:33.800113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-90844d79-7b8f-4b01-94fb-1ee11cac8ba8 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1469 microversion: 2.1 time: 0.196595 Sep 22 13:14:33.805787 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 350/757] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:33 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:33.805787 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:33.806200 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:33.812819 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.813827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:33.814266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:33.814762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.051815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-21e94f9d-f733-428a-8dea-b1db45f9debc tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 204 len: 0 microversion: 2.1 time: 0.398550 Sep 22 13:14:34.052394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 408/758] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:14:33 2021] DELETE /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:14:34.060313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:34.063525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:34.066660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.067104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.067889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.068315 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.136074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-172a54e3-5447-4fdf-a913-26598c74a4f2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action" status: 202 len: 0 microversion: 2.1 time: 0.333486 Sep 22 13:14:34.136872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 351/759] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:14:33 2021] POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:14:34.146271 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:34.146965 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:34.153917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.154362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.155245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.155971 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.205023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:34.213109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-14eb8c59-3cc1-4593-a633-68f19c8f454e tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.156423 Sep 22 13:14:34.219038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 409/760] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:34 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:34.299010 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:34.306816 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a1e9f91e-ec6e-4113-a12a-dbdabbc6905e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1753 microversion: 2.1 time: 0.164763 Sep 22 13:14:34.312525 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 352/761] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:34 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:34.382586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-dff634d1-42ff-4303-96b1-0635c1efcf57 req-7c1dbc99-a029-435c-847b-51476f20e7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7", "name": "network-vif-deleted", "tag": "0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:34.387049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:34.387049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:34.391473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-dff634d1-42ff-4303-96b1-0635c1efcf57 req-7c1dbc99-a029-435c-847b-51476f20e7d3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.391918 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-dff634d1-42ff-4303-96b1-0635c1efcf57 req-7c1dbc99-a029-435c-847b-51476f20e7d3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.403135 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-dff634d1-42ff-4303-96b1-0635c1efcf57 req-7c1dbc99-a029-435c-847b-51476f20e7d3 service nova] Creating event network-vif-deleted:0ec8a2ca-b635-4a0b-ac9d-3ea817696ff4 for instance 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 on hv-cinder-81000 Sep 22 13:14:34.408227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-dff634d1-42ff-4303-96b1-0635c1efcf57 req-7c1dbc99-a029-435c-847b-51476f20e7d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029821 Sep 22 13:14:34.408810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 410/762] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:34.510574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:34.511178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:34.517229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.517678 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.518448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.518884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.549946 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.550386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.550828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:34.593263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:34.600637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-90b724f3-354f-40c3-916a-da4849c5dede tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1307 microversion: 2.1 time: 0.094089 Sep 22 13:14:34.601872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 353/763] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:34 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:34.818357 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:34.819091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:34.826219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.826657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.827419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:34.827899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:34.947628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:34.955046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aa5183f2-adc2-4a88-9324-124ad097c934 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1469 microversion: 2.1 time: 0.141001 Sep 22 13:14:34.958549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 411/764] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:34 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1469 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:35.229787 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:35.230304 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:35.236121 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.236562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.237318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.237768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.323877 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:35.324491 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:35.330536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.330981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.331784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.332217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.358113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:35.365486 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d77fa977-8a0f-416c-addc-8a4ed85dd0dd tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.139633 Sep 22 13:14:35.366123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 354/765] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:35 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:35.453217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:35.460893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9809d52a-32c6-41d7-8020-83f2bc90442e tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1753 microversion: 2.1 time: 0.141220 Sep 22 13:14:35.461487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 412/766] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:35 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1753 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:35.617944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:35.618597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:35.624431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.624868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.625673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.626094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.656694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.657129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.657613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:35.697274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:35.704544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-34bc6eca-b25e-4f09-8990-b1dc289d3829 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1307 microversion: 2.1 time: 0.091202 Sep 22 13:14:35.705126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 355/767] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:35 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:35.974854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:35.975368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:35.982195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.982643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:35.983410 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:35.983867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.106378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:36.113593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c6adfdd1-3646-462e-bd45-bbde359b8564 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1469 microversion: 2.1 time: 0.142641 Sep 22 13:14:36.114167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 413/768] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:35 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1469 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:36.383957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:36.384916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:36.391095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.391580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.392363 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.392800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.477926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:36.478536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:36.484447 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.484925 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.485694 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.486145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.513403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:36.520767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1df8f14b-d8ef-4594-b5b5-f7a469879c33 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.141593 Sep 22 13:14:36.521503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 356/769] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:36 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:36.611149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:36.619276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a7ebd145-502b-45bd-aa29-4485d560444f tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1753 microversion: 2.1 time: 0.145081 Sep 22 13:14:36.619880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 414/770] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:36 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1753 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:36.720695 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:36.721282 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:36.727146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.727626 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.728401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.728802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.758340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:36.758774 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:36.759207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:36.800522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:36.808330 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-38a48f70-91a1-476c-9821-9c1241e0cbb8 tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1307 microversion: 2.1 time: 0.091328 Sep 22 13:14:36.808905 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 357/771] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:36 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:37.130536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:37.131138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:37.137313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.137764 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.138528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.138961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.377681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:37.386043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0444042b-394f-402d-9f6f-270c76ad2106 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1469 microversion: 2.1 time: 0.259125 Sep 22 13:14:37.386752 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 415/772] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:37 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:37.538237 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:37.539445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:37.546057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.546533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.548536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.548536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.637990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:37.638874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:37.647147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.649930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.651091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.653055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.748546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:37.757779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6f49683b-3061-431e-bfac-a86e17a64507 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.223265 Sep 22 13:14:37.768435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 358/773] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:37 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:37.774424 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-8737fa1e-73ec-4775-98b6-d7debc7eb7db req-6364d827-4a0a-4d49-8dfb-6ea0221ee505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc55bec9-bad8-4cfb-8cde-ed61e8c97a24", "name": "network-vif-deleted", "tag": "2b15b73b-052e-4534-8652-b8314f4f4eef"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:37.776384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:37.776384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:14:37.784436 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-8737fa1e-73ec-4775-98b6-d7debc7eb7db req-6364d827-4a0a-4d49-8dfb-6ea0221ee505 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.784880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-8737fa1e-73ec-4775-98b6-d7debc7eb7db req-6364d827-4a0a-4d49-8dfb-6ea0221ee505 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.797624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-8737fa1e-73ec-4775-98b6-d7debc7eb7db req-6364d827-4a0a-4d49-8dfb-6ea0221ee505 service nova] Creating event network-vif-deleted:2b15b73b-052e-4534-8652-b8314f4f4eef for instance bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 on hv-cinder-81000 Sep 22 13:14:37.803668 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-8737fa1e-73ec-4775-98b6-d7debc7eb7db req-6364d827-4a0a-4d49-8dfb-6ea0221ee505 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Sep 22 13:14:37.804715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 359/774] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:37.826078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:37.826829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:37.833170 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.840419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.840419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.840419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.871403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:37.871929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:37.872357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lazy-loading 'fault' on Instance uuid 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:37.882013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:37.898756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1d8c29e3-df97-4989-999e-26686e564788 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1753 microversion: 2.1 time: 0.265940 Sep 22 13:14:37.899268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 416/775] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:37 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:37.917895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '028372696b274b29b940bf5a602c4471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd01d73b164c0496803e15f5becaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:37.926617 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1211ac35-4966-4f50-aad6-f419293a651c tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 200 len: 1307 microversion: 2.1 time: 0.105016 Sep 22 13:14:37.927226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 360/776] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:37 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:38.403014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:38.403912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:38.409720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.410161 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.410933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.411347 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.443772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.444271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.444852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lazy-loading 'fault' on Instance uuid bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:38.484782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db7b02ec1e39454a8efc0b774cd21a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd328c1569ef144f9a18c973a5f511eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:38.492532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4f345ab3-b202-48ba-a67f-b833dbf547c6 tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 200 len: 1304 microversion: 2.1 time: 0.092954 Sep 22 13:14:38.493386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 417/777] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:38 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:38.775461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:38.776228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:38.782854 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.783331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.784152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.784587 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.916435 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:38.917204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:38.919212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:38.924335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.924790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.925768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.931562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.931828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9ddfaf88-f965-4b6c-bf28-739a303f0fa3 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.156623 Sep 22 13:14:38.931828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 361/778] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:38 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:38.943701 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:38.944306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] [instance: 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:38.951900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.952345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.953145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:38.953724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:38.968916 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] HTTP exception thrown: Instance 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 could not be found. Sep 22 13:14:38.969528 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] Returning 404 to user: Instance 7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:38.970355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c5f3b320-76e2-4d5d-8830-b48510bba0bc tempest-AttachVolumeNegativeTest-126091373 tempest-AttachVolumeNegativeTest-126091373-project] 10.222.0.43 "GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7" status: 404 len: 111 microversion: 2.1 time: 0.030795 Sep 22 13:14:38.970913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 362/779] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:38 2021] GET /compute/v2.1/servers/7cb12f2b-4d60-4e8a-b0d6-6062393cd7c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:14:39.063939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:39.074214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-35c3dc8e-7abd-4463-b4fa-f9978f1309ca tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.161907 Sep 22 13:14:39.074948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 418/780] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:38 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:39.509612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:39.510132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] [instance: bc55bec9-bad8-4cfb-8cde-ed61e8c97a24] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:39.517869 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:39.518329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:39.519149 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:39.519590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:39.534004 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] HTTP exception thrown: Instance bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 could not be found. Sep 22 13:14:39.534607 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] Returning 404 to user: Instance bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:39.535473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-996f5413-4ba4-4172-85dd-64b2a335a87f tempest-VolumesNegativeTest-750089524 tempest-VolumesNegativeTest-750089524-project] 10.222.0.43 "GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24" status: 404 len: 111 microversion: 2.1 time: 0.029903 Sep 22 13:14:39.536040 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 363/781] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:39 2021] GET /compute/v2.1/servers/bc55bec9-bad8-4cfb-8cde-ed61e8c97a24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:14:39.945171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:39.949454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:39.952260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:39.952712 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:39.953489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:39.953930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:40.087784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:40.092576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:40.093265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:40.096378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd8d483f-8632-4ed3-98dd-60ac89194d94 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.154909 Sep 22 13:14:40.097358 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 419/782] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:39 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:40.099831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:40.100275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:40.101112 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:40.101764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:40.232759 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:40.240535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-51185ebc-3117-4e4a-a0cf-41e1f181e16d tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.151808 Sep 22 13:14:40.241087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 364/783] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:40 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:41.119173 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:41.119817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:41.125759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:41.126415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:41.127174 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:41.127840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:41.253188 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:41.259879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:41.259879 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:41.261912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e96c83ba-e764-42a1-a04a-ed38af2b5ffb tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.147063 Sep 22 13:14:41.262500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 420/784] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:41 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:41.265286 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:41.265805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:41.266632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:41.267063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:41.412243 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:41.421520 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0c7b6764-3405-4947-9e07-4b948d0e4b00 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.167371 Sep 22 13:14:41.422101 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 365/785] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:41 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:42.279025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:42.282955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:42.285843 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:42.286294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:42.287072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:42.287540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:42.438537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:42.439021 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:42.439565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:42.446596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-507b1b50-052a-4ac2-a5d7-96da1812e240 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.171457 Sep 22 13:14:42.447199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:42.447978 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 421/786] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:42 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:42.448655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:42.449738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:42.450220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:42.597667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:42.606148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-32948f8a-300a-479e-83e1-06c61ddcd2af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.171782 Sep 22 13:14:42.607034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 366/787] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:42 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:43.464383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:43.464999 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:43.471018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:43.471502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:43.472281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:43.472718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:43.620687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:43.624734 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:43.625339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:43.629229 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1bb25262-7b97-4f78-b61c-803fc08780a8 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.168597 Sep 22 13:14:43.631686 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:43.632435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:43.633925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:43.634700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:43.649850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 422/788] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:43 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:43.838391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:43.839282 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d754b98f-fbda-4d99-8b28-4f5be326fa99 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.218151 Sep 22 13:14:43.839923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 367/789] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:43 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:44.649571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:44.649973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:44.659514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:44.659967 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:44.660753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:44.661189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:44.843322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:44.851248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-24f89859-5db6-494c-a7d5-cc22b4545269 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.205023 Sep 22 13:14:44.852075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 423/790] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:44 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:44.856799 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:44.857444 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:44.863238 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:44.863713 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:44.864510 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:44.864969 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:45.011659 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:45.019832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8e6236ff-0652-4b37-87b4-1eb647c6c664 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.166665 Sep 22 13:14:45.020403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 368/791] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:44 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:45.868101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:45.868947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:45.875371 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:45.875856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:45.876635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:45.877069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:46.010116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:46.018468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-404d5c01-af28-4a08-a8f7-dcc396cddd27 tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1521 microversion: 2.1 time: 0.154308 Sep 22 13:14:46.020763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 424/792] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:45 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:46.038002 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:46.039731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:46.046130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:46.046909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:46.047947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:46.048468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:46.189605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:46.199013 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f0186a3d-3d7c-46cf-997b-893f8982f340 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.164684 Sep 22 13:14:46.199607 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 369/793] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:46 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:46.964614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-292c6ccd-63c5-4915-bc86-ab4e45249e3f req-03e21461-574d-4c18-9d79-56f234002fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dd1478-ba12-4a46-8c78-62519c2c512b", "name": "network-vif-deleted", "tag": "e985e239-a74d-451d-b44e-08c49c83ef5e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:46.966462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:14:46.966462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:14:46.973538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-292c6ccd-63c5-4915-bc86-ab4e45249e3f req-03e21461-574d-4c18-9d79-56f234002fb3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:46.974052 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-292c6ccd-63c5-4915-bc86-ab4e45249e3f req-03e21461-574d-4c18-9d79-56f234002fb3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:46.985807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-292c6ccd-63c5-4915-bc86-ab4e45249e3f req-03e21461-574d-4c18-9d79-56f234002fb3 service nova] Creating event network-vif-deleted:e985e239-a74d-451d-b44e-08c49c83ef5e for instance 62dd1478-ba12-4a46-8c78-62519c2c512b on hv-cinder-81000 Sep 22 13:14:46.992335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-292c6ccd-63c5-4915-bc86-ab4e45249e3f req-03e21461-574d-4c18-9d79-56f234002fb3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030907 Sep 22 13:14:46.995225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 425/794] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:14:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:14:47.038232 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:47.038732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:47.044483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:47.044928 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:47.046850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:47.046850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:47.107345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8ecad35324343bf8403f1e8f8088f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a4440bd974592a2c14375e7f7fa18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:47.115354 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-925dfea2-fd90-4b09-836d-4e439dc82e7f tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 200 len: 1479 microversion: 2.1 time: 0.081255 Sep 22 13:14:47.116086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 370/795] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:47 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 1479 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:47.217527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:47.218389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:47.226104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:47.226651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:47.227673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:47.228061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:47.458469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:47.466630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3f1511b6-92f0-46e1-b6e8-2cc6503ab024 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.253031 Sep 22 13:14:47.476398 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 426/796] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:47 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:48.133224 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:48.134447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] [instance: 62dd1478-ba12-4a46-8c78-62519c2c512b] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:48.140758 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:48.141204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:48.142241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:48.142938 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:48.157426 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] HTTP exception thrown: Instance 62dd1478-ba12-4a46-8c78-62519c2c512b could not be found. Sep 22 13:14:48.158197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] Returning 404 to user: Instance 62dd1478-ba12-4a46-8c78-62519c2c512b could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:14:48.163850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4cb938ce-1f30-42b3-860d-b3dc7d05032a tempest-ServerRescueNegativeTestJSON-337913421 tempest-ServerRescueNegativeTestJSON-337913421-project] 10.222.0.43 "GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b" status: 404 len: 111 microversion: 2.1 time: 0.030341 Sep 22 13:14:48.163850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 371/797] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:48 2021] GET /compute/v2.1/servers/62dd1478-ba12-4a46-8c78-62519c2c512b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:14:48.484520 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:48.485164 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:48.493162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:48.493963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:48.494950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:48.495382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:48.723968 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:48.732603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f64fb8fd-84fe-4d39-9aaf-7ae139172cbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.252476 Sep 22 13:14:48.733170 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 427/798] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:48 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:49.748842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:49.749445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:49.755411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:49.755885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:49.757395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:49.758029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:49.886203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:49.893953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b60e4b22-23e2-4fa6-80f3-072c03c44298 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.148958 Sep 22 13:14:49.894514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 372/799] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:49 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:50.912505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:50.913645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:50.923214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:50.923692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:50.924484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:50.924922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:51.072797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:51.081284 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6957a3ba-a7ea-4da3-978c-fdf34f9c6341 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.172473 Sep 22 13:14:51.082598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 428/800] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:50 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:52.099697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:52.100967 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:52.108083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:52.108622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:52.109522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:52.110201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:52.277789 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:52.286280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f25043e1-551e-4154-885a-7c474b23b5c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.190123 Sep 22 13:14:52.288171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 373/801] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:52 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:52.327565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:52.328929 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:52.336390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:52.337000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:52.338123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:52.338868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:52.434487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lazy-loading 'services' on Instance uuid 34469eaa-a287-41e5-a5cd-ad889e389ada {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:14:52.655000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-96b59f13-a44c-4cc8-ae30-b75692f913f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments/1ccebf2a-af40-476d-9cdd-0f01323ccb4f" status: 202 len: 0 microversion: 2.1 time: 0.331269 Sep 22 13:14:52.655701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 429/802] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:14:52 2021] DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments/1ccebf2a-af40-476d-9cdd-0f01323ccb4f => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:14:53.306307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:53.307372 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:53.315221 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:53.315721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:53.316647 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:53.317087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:53.441501 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:53.450887 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-eec95269-d155-4748-8c62-3abab02569ba tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.149272 Sep 22 13:14:53.451649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 374/803] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:53 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:14:53.809091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97a30839-6fef-40b8-a741-64bad4749791 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:14:53.815849 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a30839-6fef-40b8-a741-64bad4749791 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:53.816294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a30839-6fef-40b8-a741-64bad4749791 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:53.838195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97a30839-6fef-40b8-a741-64bad4749791 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Going to try to stop instance {{(pid=109168) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 22 13:14:54.062097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97a30839-6fef-40b8-a741-64bad4749791 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 202 len: 0 microversion: 2.1 time: 0.256862 Sep 22 13:14:54.062722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 430/804] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:14:53 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:14:54.071373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:54.071969 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:54.077870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:54.078309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:54.079117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:54.079586 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:54.226960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:54.236723 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b66f163c-dfd5-4c6c-84bd-5f5fe32173a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.169738 Sep 22 13:14:54.237545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 375/805] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:54 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:54.468263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:54.468964 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:54.476084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:54.476599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:54.477662 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:54.478244 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:54.641873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:54.650165 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-30903615-c549-44ad-93ea-c781a9c01022 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.185860 Sep 22 13:14:54.650738 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 431/806] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:54 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:55.253838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:55.254452 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:55.261562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:55.262590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:55.263556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:55.264331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:55.416121 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:55.423855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-413f39b4-264a-4dea-a7ff-7a408391d97d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.173596 Sep 22 13:14:55.424451 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 376/807] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:55 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:55.667567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:55.668175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:55.673977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:55.680672 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:55.681487 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:55.681929 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:55.819404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:55.827299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-72046ece-7eeb-4745-a5a3-61420faaac5c tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.163314 Sep 22 13:14:55.827907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 432/808] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:55 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:56.445444 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:56.446076 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:56.453948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:56.454403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:56.455836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:56.456529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:56.608650 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:56.611074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bd066e81-50e2-4e29-9f07-af25675be2a8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.172770 Sep 22 13:14:56.612697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 377/809] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:56 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:56.844166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:56.844799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:56.850708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:56.851146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:56.851951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:56.852410 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:57.050848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:57.076915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-aba6c18d-fbc0-4ccf-b1c5-79f564b89df7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1758 microversion: 2.1 time: 0.236303 Sep 22 13:14:57.079461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 433/810] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:56 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:57.627684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:57.628402 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:57.635110 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:57.635805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:57.636601 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:57.637179 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:57.792311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:57.800802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4cdb3050-e686-4ba8-bb39-440d825f0582 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.176924 Sep 22 13:14:57.811985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 378/811] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:57 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:58.096612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:58.097931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:58.106012 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:58.106582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:58.107521 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:58.108392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:58.234268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:58.244337 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-89219ed3-8414-40ad-a347-fed8dbac7c6b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1761 microversion: 2.1 time: 0.153020 Sep 22 13:14:58.244918 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 434/812] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:58 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1761 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:58.817878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:58.818917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:58.826432 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:58.826958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:58.828326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:58.828767 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:58.957514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:14:58.965033 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c3e62c06-cda0-4250-af82-a2dc3dfcc472 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.150925 Sep 22 13:14:58.965600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 379/813] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:58 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:14:59.981806 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:14:59.982548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:14:59.988885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:59.989334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:14:59.990685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:14:59.991157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:00.118334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:00.126095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5bcbe5d4-7e3a-49aa-9d73-a1449fbc81da tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.147965 Sep 22 13:15:00.126673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 435/814] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:14:59 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:00.867084 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1853755754", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "88a73b91-5979-401e-ac30-5b2fa30cb9ce"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:00.918959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] validate_networks() for [('88a73b91-5979-401e-ac30-5b2fa30cb9ce', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:15:01.144709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:01.145780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:01.155854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:01.158060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:01.158060 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:01.158642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:01.290240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:15:01.290240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:15:01.290700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:15:01.291113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:15:01.292501 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:15:01.303953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:01.304636 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:01.305622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:01.306271 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:01.325510 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:01.326382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Getting quotas for project 2009da3841b14ba69e6be541cc0ec136. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:15:01.330658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Getting quotas for user 77151483b3db49db9576b812654d46ca and project 2009da3841b14ba69e6be541cc0ec136. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:15:01.335084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-56319dcc-3b83-4780-bfda-5d17e72c6bbc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.195090 Sep 22 13:15:01.336286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 436/815] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:01 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:01.352535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:15:01.358959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:15:01.533547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-52790938-4f35-440e-9ba9-f81330137426 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670914 Sep 22 13:15:01.534410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 380/816] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:15:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:15:01.544930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20dacbe5-d11c-44c9-9b4b-da792e3d4144 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:01.545535 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20dacbe5-d11c-44c9-9b4b-da792e3d4144 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:01.602302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20dacbe5-d11c-44c9-9b4b-da792e3d4144 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:01.609626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20dacbe5-d11c-44c9-9b4b-da792e3d4144 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1219 microversion: 2.1 time: 0.068597 Sep 22 13:15:01.610200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 437/817] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:01 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:02.353331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:02.353890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:02.360620 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:02.361102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:02.362164 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:02.363183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:02.491065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:02.498818 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-46c3f598-8f5c-4d86-b563-79675f730f34 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.150099 Sep 22 13:15:02.499396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 381/818] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:02 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:02.626169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-81bd50ac-1524-4678-abf7-847b61135d9f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:02.626704 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-81bd50ac-1524-4678-abf7-847b61135d9f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:02.681014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-81bd50ac-1524-4678-abf7-847b61135d9f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:02.688332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-81bd50ac-1524-4678-abf7-847b61135d9f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1219 microversion: 2.1 time: 0.065896 Sep 22 13:15:02.688894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 438/819] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:02 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:03.516571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:03.517250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:03.523564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:03.524021 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:03.528874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:03.532153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:03.693515 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:03.701988 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-919aaba5-2fd1-450d-a376-1431fa94f54a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.189051 Sep 22 13:15:03.702803 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 382/820] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:03 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:03.706451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:03.709485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:03.716030 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:03.716474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:03.717248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:03.717681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:03.781505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:03.792276 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-621770c9-ea11-40e2-9995-c07cb21ee2f6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1215 microversion: 2.1 time: 0.090524 Sep 22 13:15:03.802154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 439/821] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:03 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:04.720335 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:04.720929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:04.726907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:04.727371 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:04.728166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:04.728622 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:04.809476 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:04.810090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:04.816090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:04.816623 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:04.817486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:04.818447 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:04.871509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:04.883556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-644d5e72-4594-4bad-b3d0-f2d104bf6c68 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1678 microversion: 2.1 time: 0.166956 Sep 22 13:15:04.884133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 383/822] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:04 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:04.908216 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:04.908216 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0747e788-cf78-42fa-a017-1279bf5bce3e tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1279 microversion: 2.1 time: 0.099851 Sep 22 13:15:04.908216 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 440/823] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:04 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:05.901023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:05.901877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:05.907662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:05.908160 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:05.908929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:05.909358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:05.923643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:05.927641 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:05.931048 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:05.931605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:05.932382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:05.932858 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:06.042311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:06.049646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-adcb71eb-a480-4dfb-9b64-4b8793d79562 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1655 microversion: 2.1 time: 0.152406 Sep 22 13:15:06.050220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 384/824] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:05 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:06.073917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a86c0300-f2de-4a88-a828-bf680253b85c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:06.079938 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a86c0300-f2de-4a88-a828-bf680253b85c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:06.080385 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a86c0300-f2de-4a88-a828-bf680253b85c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:06.101232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:06.105153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a86c0300-f2de-4a88-a828-bf680253b85c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Going to try to start instance {{(pid=109167) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 22 13:15:06.108543 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5061c788-991b-45ee-a5fe-d71184b0d93f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.188738 Sep 22 13:15:06.109314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 441/825] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:05 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:06.308991 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a86c0300-f2de-4a88-a828-bf680253b85c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action" status: 202 len: 0 microversion: 2.1 time: 0.238088 Sep 22 13:15:06.314024 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 385/826] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:15:06 2021] POST /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:15:06.321822 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:06.322564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:06.328726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:06.329169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:06.329935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:06.330386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:06.486969 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-a5198856-30e9-4d75-880a-7bfebf1e34d8 req-7a268684-3193-4c5a-af4c-5b57c7bbb9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50", "tag": "bbbb0eab-72e6-4c66-ba19-cc778571757d"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:06.489176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:06.489176 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:15:06.499344 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-a5198856-30e9-4d75-880a-7bfebf1e34d8 req-7a268684-3193-4c5a-af4c-5b57c7bbb9db service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:06.499956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-a5198856-30e9-4d75-880a-7bfebf1e34d8 req-7a268684-3193-4c5a-af4c-5b57c7bbb9db service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:06.517687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-a5198856-30e9-4d75-880a-7bfebf1e34d8 req-7a268684-3193-4c5a-af4c-5b57c7bbb9db service nova] Creating event network-changed:bbbb0eab-72e6-4c66-ba19-cc778571757d for instance 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 on hv-cinder-81000 Sep 22 13:15:06.518698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:06.523670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-a5198856-30e9-4d75-880a-7bfebf1e34d8 req-7a268684-3193-4c5a-af4c-5b57c7bbb9db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041634 Sep 22 13:15:06.524822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 386/827] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:15:06.527837 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-31648c9b-01d1-4b70-876e-ce315ac18fba tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1664 microversion: 2.1 time: 0.210608 Sep 22 13:15:06.528397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 442/828] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:06 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:07.126299 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:07.127097 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:07.133546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:07.134074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:07.134909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:07.135404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:07.334001 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:07.341697 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-24a26636-f73f-4df8-915f-7ed487f0c506 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.219426 Sep 22 13:15:07.342269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 387/829] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:07 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:07.545184 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:07.545831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:07.551986 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:07.552470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:07.553252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:07.553844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:07.681844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:07.689562 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fef087aa-9843-49fa-aed0-aa7280ccdef7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1664 microversion: 2.1 time: 0.148112 Sep 22 13:15:07.690180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 443/830] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:07 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:08.360544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:08.361173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:08.367283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:08.367773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:08.368539 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:08.368971 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:08.601217 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:08.609130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f630b9af-cd2c-4296-bc84-5f15ed4225ad tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.253217 Sep 22 13:15:08.609707 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 388/831] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:08 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:08.746644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:08.747362 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:08.753477 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:08.753972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:08.755505 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:08.755955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:08.891872 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:08.900538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-089d32c1-92e5-440c-9c95-8fa08f5e23c9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1668 microversion: 2.1 time: 0.157962 Sep 22 13:15:08.901130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 444/832] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:08 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:09.626693 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:09.627381 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:09.633453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:09.633894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:09.634661 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:09.635085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:09.759074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:09.768813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-622b0ad2-cf41-4383-aaec-08710c7c94ca tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.145758 Sep 22 13:15:09.769392 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 389/833] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:09 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:10.786870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:10.787548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:10.794648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:10.795196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:10.796589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:10.796589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:10.924969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:10.932949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f4f623ae-2e3a-4221-bf63-fdeec0ab3a18 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.150576 Sep 22 13:15:10.933537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 445/834] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:10 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:11.950495 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:11.951018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:11.956935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:11.957383 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:11.958877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:11.959315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.086817 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:12.091148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b0b769fc-fe00-4101-afef-583d23b3151f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.144501 Sep 22 13:15:12.091755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 390/835] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:11 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:12.290530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:12.291062 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:12.297019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.297465 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.298344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.298777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.328401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d21b0415-23b8-4c61-aaba-37e29aab3316 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments/4ce6329f-dd43-4587-b139-82bf9bdabe15" status: 200 len: 194 microversion: 2.20 time: 0.042373 Sep 22 13:15:12.329002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 446/836] 10.222.0.43 () {60 vars in 1454 bytes} [Wed Sep 22 13:15:12 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments/4ce6329f-dd43-4587-b139-82bf9bdabe15 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:15:12.406406 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:12.406922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:12.413269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.413718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.414492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.414923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.503801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lazy-loading 'services' on Instance uuid a4d69add-5d3b-4453-bf51-5a27d905e4e7 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:15:12.791658 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e35f0fe9-f5a1-4b4f-ac6f-bc70191d62c5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments/4ce6329f-dd43-4587-b139-82bf9bdabe15" status: 202 len: 0 microversion: 2.20 time: 0.388944 Sep 22 13:15:12.792279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 391/837] 10.222.0.43 () {60 vars in 1457 bytes} [Wed Sep 22 13:15:12 2021] DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments/4ce6329f-dd43-4587-b139-82bf9bdabe15 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:15:12.804604 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:12.805583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:12.811514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.811965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.812733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:12.813167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:12.844057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ff74d87d-f4a7-4b2f-a6d3-3ff56972daa1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043233 Sep 22 13:15:12.844634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 447/838] 10.222.0.43 () {60 vars in 1343 bytes} [Wed Sep 22 13:15:12 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:15:13.108936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:13.109633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:13.115753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.116201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.117010 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.117444 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.239369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:13.246624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3f491cbb-941d-4b62-a728-086824c947a6 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.141973 Sep 22 13:15:13.247197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 392/839] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:13 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:13.690876 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-49ef0a0c-b890-4cd2-ab37-def2fe813805 req-fe5882c0-5ea3-4c18-bbdc-9cc606e715bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50", "name": "network-vif-plugged", "status": "completed", "tag": "bbbb0eab-72e6-4c66-ba19-cc778571757d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:13.696245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:13.696245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:15:13.704096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-49ef0a0c-b890-4cd2-ab37-def2fe813805 req-fe5882c0-5ea3-4c18-bbdc-9cc606e715bb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.704621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-49ef0a0c-b890-4cd2-ab37-def2fe813805 req-fe5882c0-5ea3-4c18-bbdc-9cc606e715bb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.716811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-49ef0a0c-b890-4cd2-ab37-def2fe813805 req-fe5882c0-5ea3-4c18-bbdc-9cc606e715bb service nova] Creating event network-vif-plugged:bbbb0eab-72e6-4c66-ba19-cc778571757d for instance 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 on hv-cinder-81000 Sep 22 13:15:13.721856 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-49ef0a0c-b890-4cd2-ab37-def2fe813805 req-fe5882c0-5ea3-4c18-bbdc-9cc606e715bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034802 Sep 22 13:15:13.722647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 448/840] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:15:13.856092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:13.857058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:13.863814 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.864962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.865830 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.866315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.902928 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-91b0ca12-ce65-40e7-9d07-35ff0700b311 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051349 Sep 22 13:15:13.909162 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 393/841] 10.222.0.43 () {60 vars in 1343 bytes} [Wed Sep 22 13:15:13 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:13.974467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:13.975665 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:13.982409 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.986204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:13.986204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:13.986204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:14.012434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:15:14.263838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:14.265535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:14.270898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:14.271350 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:14.272140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:14.272574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:14.363273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3020af0b-b866-4e4d-acd1-3d1939041c40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 204 len: 0 microversion: 2.20 time: 0.392301 Sep 22 13:15:14.363273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 449/842] 10.222.0.43 () {60 vars in 1280 bytes} [Wed Sep 22 13:15:13 2021] DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 13:15:14.372150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:14.373448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:14.379326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:14.379974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:14.380913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:14.381378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:14.408648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:14.417922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-50e28bb4-a4a6-4bd5-b855-a6739d954395 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.157737 Sep 22 13:15:14.419052 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 394/843] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:14 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:15:14.532613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:14.542211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:14.543854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:14.545101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8800a887-0d4e-4ac4-b5fd-46e87bf87fca tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.177713 Sep 22 13:15:14.545956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 450/844] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:14 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:15.433940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:15.434624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:15.440361 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:15.440801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:15.441546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:15.442103 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:15.564852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:15.565442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:15.566955 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:15.571873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:15.572379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:15.573338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:15.573944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:15.575367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0264425a-54b1-4b61-9b3f-6c6436c2063f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1319 microversion: 2.1 time: 0.145137 Sep 22 13:15:15.576365 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 395/845] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:15 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:15.718157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:15.726420 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:15.729234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:15.729234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f2cfc2f6-e04e-4f2a-89ce-2c27b86752e4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.168192 Sep 22 13:15:15.729664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 451/846] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:15 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:16.594047 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:16.594692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:16.601563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:16.602012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:16.602795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:16.603229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:16.748248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:16.748708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:16.755202 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:16.758083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:16.762539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:16.762539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:16.872930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:16.886187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8e2d6f35-05cc-4db7-877e-464e56620454 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1508 microversion: 2.1 time: 0.295806 Sep 22 13:15:16.887578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 396/847] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:15:16 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:15:16.939275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:16.955330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:16.957387 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:16.959150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-fc9ce118-6632-4333-85c5-3bcc92dbff26 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1723 microversion: 2.20 time: 0.215026 Sep 22 13:15:16.960101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 452/848] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:16 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:17.747155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-cbf3c6f7-f6c5-4e3c-a24d-200f2efe2d9d req-dbc6e5a8-3760-4b5b-804a-c1dc67bbcc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d69add-5d3b-4453-bf51-5a27d905e4e7", "name": "network-vif-deleted", "tag": "f7c357bd-91b5-4b33-a096-555dac674c13"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:17.748719 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:17.748719 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:15:17.757651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-cbf3c6f7-f6c5-4e3c-a24d-200f2efe2d9d req-dbc6e5a8-3760-4b5b-804a-c1dc67bbcc1d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:17.758099 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-cbf3c6f7-f6c5-4e3c-a24d-200f2efe2d9d req-dbc6e5a8-3760-4b5b-804a-c1dc67bbcc1d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:17.777156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-cbf3c6f7-f6c5-4e3c-a24d-200f2efe2d9d req-dbc6e5a8-3760-4b5b-804a-c1dc67bbcc1d service nova] Creating event network-vif-deleted:f7c357bd-91b5-4b33-a096-555dac674c13 for instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 on hv-cinder-81000 Sep 22 13:15:17.782245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-cbf3c6f7-f6c5-4e3c-a24d-200f2efe2d9d req-dbc6e5a8-3760-4b5b-804a-c1dc67bbcc1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 Sep 22 13:15:17.782856 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 397/849] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:15:17.978687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:17.979293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:17.987173 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:17.988565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:17.990028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:17.990740 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:18.081177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:18.090325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:18.091867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:18.093225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-372a8acf-be2d-4077-865e-efa8c18960b7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 200 len: 1367 microversion: 2.20 time: 0.118423 Sep 22 13:15:18.093791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 453/850] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:17 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:19.122134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:19.123934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:19.133005 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:19.134220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:19.136267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:19.136930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:19.154614 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. Sep 22 13:15:19.155366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:15:19.156611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a6a88c47-371f-4035-aa24-2b618add8c52 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 404 len: 111 microversion: 2.20 time: 0.047478 Sep 22 13:15:19.157252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 398/851] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:19 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:15:19.167366 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-caadc03c-fffc-4ab2-84b6-d954f21a1368 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '.version_select at 0x7fa7181798b0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:19.170942 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-caadc03c-fffc-4ab2-84b6-d954f21a1368 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [7018315b-d2a0-46b6-8ed3-da28052ba31d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 13:15:20.188878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [None req-caadc03c-fffc-4ab2-84b6-d954f21a1368 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [7018315b-d2a0-46b6-8ed3-da28052ba31d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 36724. Sep 22 13:15:20.353103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-caadc03c-fffc-4ab2-84b6-d954f21a1368 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932837670" status: 204 len: 0 microversion: 2.20 time: 1.189976 Sep 22 13:15:20.358028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 454/852] 10.222.0.43 () {60 vars in 1262 bytes} [Wed Sep 22 13:15:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932837670 => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 13:15:21.278975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: .version_select at 0x7fa7181ea670>, body: {"keypair": {"name": "tempest-keypair-1971069780"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:21.308593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:15:21.312463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:15:21.871532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:15:21.875066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:15:21.888796 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bf7073da-a237-4b47-a663-cd1da863c804 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.613956 Sep 22 13:15:21.889445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 399/853] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Sep 22 13:15:21 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 615 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 22 13:15:24.544267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1484816373", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc619f7c-a032-4a42-ba73-abb931db8402"}], "security_groups": [{"name": "tempest-securitygroup--1280763567"}], "key_name": "tempest-keypair-1971069780", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:24.636271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] validate_networks() for [('cc619f7c-a032-4a42-ba73-abb931db8402', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:15:25.249698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:15:25.250126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:15:25.250617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:15:25.251019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:15:25.251444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:15:25.260127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:25.260564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:25.261340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:25.261770 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:25.278079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for project a9b927b18a264e798ad9389f4c099037. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:15:25.281930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Getting quotas for user 1eff64a9da614bd2b032bdc469a62b0e and project a9b927b18a264e798ad9389f4c099037. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:15:25.293093 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:15:25.295567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:15:25.645154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f9826594-f06d-4795-b330-28c056fa3b94 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.104994 Sep 22 13:15:25.646109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 455/854] 10.222.0.43 () {62 vars in 1188 bytes} [Wed Sep 22 13:15:24 2021] POST /compute/v2.1/servers => generated 402 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 13:15:25.656909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:25.663024 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:25.711574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:25.718563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:25.720125 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:25.721232 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4d7e9eca-fd74-4fd9-b0ae-5aa471eb27a1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1282 microversion: 2.20 time: 0.068175 Sep 22 13:15:25.721790 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 400/855] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:25 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:26.740620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:26.741248 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:26.748262 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:26.751332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:26.751332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:26.751332 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:26.808432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:26.816379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:26.817886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:26.818989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ad99a353-c5f2-4f67-933a-ebacca155cfc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1286 microversion: 2.20 time: 0.083403 Sep 22 13:15:26.819568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 456/856] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:26 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:27.836453 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:27.837150 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:27.843621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:27.844071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:27.844848 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:27.845280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:27.908201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:27.917332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:27.918866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:27.919999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-32f1f5b4-1a06-4506-a6e4-f7eb0fee3ebc tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1278 microversion: 2.20 time: 0.087323 Sep 22 13:15:27.920568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 401/857] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:27 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:28.938512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:28.939052 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:28.945242 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:28.945731 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:28.946545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:28.947015 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:29.016258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:29.024509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:29.026293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:29.027415 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5ecf65c9-d3cb-4395-861a-fb4bad7c94ec tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1334 microversion: 2.20 time: 0.093031 Sep 22 13:15:29.027971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 457/858] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:28 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:30.046045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:30.046635 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:30.053158 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:30.053595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:30.054358 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:30.054783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:30.113925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:30.122083 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:30.123598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:30.124707 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1095d202-28a5-4734-8919-88403ed39977 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1334 microversion: 2.20 time: 0.082395 Sep 22 13:15:30.125263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 402/859] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:30 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:31.145799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:31.146400 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:31.152759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:31.153205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:31.154018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:31.154444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:31.212699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:31.220267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:31.221795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:31.222973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-50882903-4951-4966-9c4e-c6054087b423 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1342 microversion: 2.20 time: 0.081636 Sep 22 13:15:31.223545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 458/860] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:31 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:32.241301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:32.241934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:32.251692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:32.252138 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:32.253030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:32.253662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:32.322969 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:32.331551 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:32.335755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:32.335755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-75602bc2-e3f0-4d5c-a7c8-8991ad4b7b13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1340 microversion: 2.20 time: 0.097362 Sep 22 13:15:32.335755 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 403/861] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:32 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:33.351955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:33.352596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:33.359061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:33.359539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:33.360375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:33.360813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:33.481213 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-26643f10-3eb7-4b55-856a-d7970397add0 req-33cf0079-6e5b-449d-b4d1-25cff97884fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:33.483872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:33.483872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:15:33.486628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:33.495338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-26643f10-3eb7-4b55-856a-d7970397add0 req-33cf0079-6e5b-449d-b4d1-25cff97884fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:33.495338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-26643f10-3eb7-4b55-856a-d7970397add0 req-33cf0079-6e5b-449d-b4d1-25cff97884fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:33.497666 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:33.499471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:33.500721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-67f667cd-471f-4928-aa31-53eaea688967 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.152935 Sep 22 13:15:33.501323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 459/862] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:33 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:33.533183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-26643f10-3eb7-4b55-856a-d7970397add0 req-33cf0079-6e5b-449d-b4d1-25cff97884fa service nova] Creating event network-changed:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:15:33.535355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-26643f10-3eb7-4b55-856a-d7970397add0 req-33cf0079-6e5b-449d-b4d1-25cff97884fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059333 Sep 22 13:15:33.535996 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 404/863] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:15:34.519512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:34.520116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:34.526192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:34.526628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:34.527383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:34.527838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:34.655768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:34.664251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:34.665756 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:34.666865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bdae8e48-2492-48da-a475-9c377a457b40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.151697 Sep 22 13:15:34.667451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 460/864] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:34 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:35.684924 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:35.685621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:35.692890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:35.692890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:35.693551 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:35.693977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:35.817153 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:35.825874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:35.827374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:35.828534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d9f0eecd-464a-4552-8de0-00e315656a13 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.147812 Sep 22 13:15:35.829090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 405/865] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:35 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:36.845951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:36.846592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:36.852555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:36.853002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:36.853769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:36.854203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:36.984409 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:36.994078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:37.000140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:37.000140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b12b6864-9a47-4da8-9374-758093879083 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.154661 Sep 22 13:15:37.000140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 461/866] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:36 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:38.016529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:38.017130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:38.023769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:38.024216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:38.025276 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:38.025708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:38.146632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:38.154689 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:38.156252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:38.157396 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-30c25ef9-dd7f-4940-9e3c-c2db7edbdff6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.144659 Sep 22 13:15:38.157958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 406/867] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:38 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:39.181145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:39.181751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:39.187690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:39.188127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:39.188887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:39.189313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:39.309644 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:39.318025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:39.319565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:39.320687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-751c0454-d0e5-46fc-b7b8-1d64536acaeb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.143247 Sep 22 13:15:39.321239 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 462/868] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:39 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:40.337889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:40.338606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:40.345154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:40.345601 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:40.346376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:40.346808 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:40.469100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:40.477624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:40.479161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:40.480284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0ac40449-d0f3-44a2-8634-6774a2018901 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.146061 Sep 22 13:15:40.480838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 407/869] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:40 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:41.498765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:41.499365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:41.505888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:41.506339 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:41.507104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:41.507575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:41.621617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca28f11a-69c9-4472-8016-495d73f9a384] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 13:15:41.637428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:41.645677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:41.647154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:41.648394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5eeadc65-3d4e-4f37-b4de-4b308b45f416 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.153233 Sep 22 13:15:41.648894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 463/870] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:41 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:42.665867 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:42.666871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:42.669714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4de4d457-e521-4523-925d-5fa208feca2f] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 13:15:42.674718 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:42.675687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:42.676563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:42.676999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:42.806405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:42.814398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:42.816538 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:42.817645 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2e98154a-e8c2-4ebe-8471-1f6515c38bb4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.155896 Sep 22 13:15:42.818206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 408/871] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:42 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:43.835103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:43.835722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:43.852255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:43.852695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:43.853458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:43.853886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:43.859485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca28f11a-69c9-4472-8016-495d73f9a384] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37096. Sep 22 13:15:43.975119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:43.982688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:43.984204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:43.985304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ec168bce-7c19-44b3-b6ed-64204c855dbf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.154043 Sep 22 13:15:43.985859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 464/872] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:43 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:45.002868 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:45.004004 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:45.021230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:45.021679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:45.022455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:45.022894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:45.028242 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] [4de4d457-e521-4523-925d-5fa208feca2f] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37108. Sep 22 13:15:45.144577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:45.153046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:45.154534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:45.155670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-145aece5-732f-4c33-a99c-4997605fcfc6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.156586 Sep 22 13:15:45.156229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 409/873] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:44 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:46.173532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:46.174544 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:46.180839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:46.181289 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:46.182097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:46.182533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:46.315873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:46.319830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:46.321358 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:46.322533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1e62b92e-1589-4d5f-9d90-4043601b0f84 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.153425 Sep 22 13:15:46.323097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 465/874] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:46 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:46.436283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4224002f-0716-4510-94a4-b42cd6d1b6eb", "device": "/dev/sdb"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:46.437821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:46.444616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:46.445052 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:46.445826 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:46.446240 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:47.342002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:47.342002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:47.348887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:47.349325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:47.350301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:47.350744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:47.463088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bf38273b-5f59-4d95-9492-23e414f6ea8d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "POST /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030508 Sep 22 13:15:47.468566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 410/875] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:15:46 2021] POST /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:15:47.496313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:47.504972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:47.506508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:47.507577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-6a93a421-cb76-4a5e-967a-27ac51641a2f req-4c5c52bb-d1e9-48f3-8dea-428e36a6de23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "name": "network-vif-plugged", "status": "completed", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:47.507771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c351b470-f348-4bf9-a6a5-01250e7d4be6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.170097 Sep 22 13:15:47.508326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 466/876] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:47 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:15:47.510127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:47.510127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:15:47.520339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-6a93a421-cb76-4a5e-967a-27ac51641a2f req-4c5c52bb-d1e9-48f3-8dea-428e36a6de23 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:47.520785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-6a93a421-cb76-4a5e-967a-27ac51641a2f req-4c5c52bb-d1e9-48f3-8dea-428e36a6de23 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:47.531294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-6a93a421-cb76-4a5e-967a-27ac51641a2f req-4c5c52bb-d1e9-48f3-8dea-428e36a6de23 service nova] Creating event network-vif-plugged:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:15:47.536338 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-6a93a421-cb76-4a5e-967a-27ac51641a2f req-4c5c52bb-d1e9-48f3-8dea-428e36a6de23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038088 Sep 22 13:15:47.537122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 411/877] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:15:48.525974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:48.526611 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:48.532519 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:48.532965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:48.533727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:48.534166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:48.656389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:48.664390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:48.665874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:48.666982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4724e218-0c4d-4a37-9123-f16a78d3be36 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.145182 Sep 22 13:15:48.667747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 467/878] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:48 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:49.686466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:49.687154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:49.694079 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:49.694527 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:49.695312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:49.695784 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:49.815026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:49.822708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:49.824236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:49.825503 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fcf9a2f6-588e-4a2e-bcdf-5be0a7e6a97e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.143566 Sep 22 13:15:49.825890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 412/879] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:49 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:50.842801 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:50.843932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:50.850055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:50.850504 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:50.851365 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:50.852017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:50.982457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:50.991495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:50.992998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:50.994133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eebf5f22-cfe3-4461-84fd-e00ac88e5c51 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.155076 Sep 22 13:15:50.994700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 468/880] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:50 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:52.013111 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:52.013722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:52.021769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:52.022182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:52.023156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:52.023491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:52.147081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:52.155287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:52.156880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:52.157987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fa625aa8-4a24-4185-babf-3237fabcae6a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.148743 Sep 22 13:15:52.158556 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 413/881] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:52 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:53.175527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:53.176112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:53.182073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:53.182548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:53.183323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:53.183786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:53.311810 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:53.320900 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:53.322470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:53.323617 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c5448b01-6443-4523-bc77-6ff0f63c1b96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.152036 Sep 22 13:15:53.324188 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 469/882] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:53 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:54.341873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:54.342523 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:54.350598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:54.351281 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:54.352412 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:54.352852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:54.479044 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:54.487035 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:54.488811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:54.494350 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-af97148e-e2b6-47be-a330-1aef2f7e0f18 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1408 microversion: 2.20 time: 0.152450 Sep 22 13:15:54.494350 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 414/883] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:54 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:55.509115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:55.509782 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:55.515497 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:55.515936 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:55.516753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:55.517169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:55.642809 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:55.651501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:55.652975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:15:55.654172 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9aa3a62d-b5b1-4d90-9ee2-ac904fe44859 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1600 microversion: 2.20 time: 0.148810 Sep 22 13:15:55.654761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 470/884] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:15:55 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:15:55.671421 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:15:55.672003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:55.678283 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:55.678714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:55.679502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:55.679929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:55.771450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-27289ed7-4f83-4e21-a7b9-fa6ec851cc78 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103790 Sep 22 13:15:55.772081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 415/885] 10.222.0.43 () {60 vars in 1316 bytes} [Wed Sep 22 13:15:55 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:15:57.000820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:57.006524 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-78145e2b-ab34-40f6-9c45-f084e2584dbe req-3b173444-06aa-4d75-86ba-6866cc9f8729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:15:57.006524 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:15:57.006524 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:15:57.007696 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:15:57.016570 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-78145e2b-ab34-40f6-9c45-f084e2584dbe req-3b173444-06aa-4d75-86ba-6866cc9f8729 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:57.017010 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-78145e2b-ab34-40f6-9c45-f084e2584dbe req-3b173444-06aa-4d75-86ba-6866cc9f8729 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:57.019827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:57.020536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:57.022166 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:15:57.023184 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:15:57.033422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-78145e2b-ab34-40f6-9c45-f084e2584dbe req-3b173444-06aa-4d75-86ba-6866cc9f8729 service nova] Creating event network-changed:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:15:57.045225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-78145e2b-ab34-40f6-9c45-f084e2584dbe req-3b173444-06aa-4d75-86ba-6866cc9f8729 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045505 Sep 22 13:15:57.046717 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 416/886] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:15:59.496512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-38ce0995-e4ed-4eca-94ee-39aca6e04f0d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 2.500695 Sep 22 13:15:59.497441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 471/887] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:15:56 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:00.514763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:00.515799 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:00.522086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:00.522517 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:00.523615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:00.524056 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:00.592555 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6d105bfe-463f-404d-8fc8-7f93b7fb1eef tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 0.083114 Sep 22 13:16:00.593229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 417/888] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:00 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:01.606750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:01.607851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:01.616206 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:01.616651 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:01.617441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:01.617874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:01.687608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e8fc3ee8-29a3-4e88-b2fe-33a167b9c9c6 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 0.086150 Sep 22 13:16:01.688258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 472/889] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:01 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:02.699311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:02.700347 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:02.707357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:02.713902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:02.713902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:02.713902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:05.135050 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-03cc7588-edae-4c2f-8524-020f1692b54b tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 2.439848 Sep 22 13:16:05.136277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 418/890] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:02 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:05.392926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1738173678"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:05.393586 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:05.400531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:05.400981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:05.401778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:05.402220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:05.682233 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.network.security_group_api [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Removing security group af77cbcc-034c-4fea-b39e-7d03255ba961 from port 198d6688-72fa-45fc-bcd9-c314e7fa6b0e Sep 22 13:16:06.103126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-dd4cc2da-f118-4afa-bf0e-450f22f29c4b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action" status: 202 len: 0 microversion: 2.1 time: 0.714633 Sep 22 13:16:06.104364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 473/891] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:05 2021] POST /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:06.127694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-5bc7e43e-7262-48c8-991d-ad466eb14922 req-3e219328-92a9-4743-b450-3eabc9d7ce19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:06.127694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:06.127694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:06.150015 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:06.150828 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:06.160577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5bc7e43e-7262-48c8-991d-ad466eb14922 req-3e219328-92a9-4743-b450-3eabc9d7ce19 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:06.163919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:06.164515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:06.165299 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:06.165727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:06.166731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5bc7e43e-7262-48c8-991d-ad466eb14922 req-3e219328-92a9-4743-b450-3eabc9d7ce19 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:06.216348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-5bc7e43e-7262-48c8-991d-ad466eb14922 req-3e219328-92a9-4743-b450-3eabc9d7ce19 service nova] Creating event network-changed:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:16:06.224746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-5bc7e43e-7262-48c8-991d-ad466eb14922 req-3e219328-92a9-4743-b450-3eabc9d7ce19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111446 Sep 22 13:16:06.228355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 419/892] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:06.278179 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-94305c44-4b9c-42a4-b8c2-2813b0530dbd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 0.134080 Sep 22 13:16:06.282866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 474/893] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:06 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:07.290246 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:07.291270 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:07.297651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.298086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.298871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.299605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.522329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:07.523597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:07.530742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.531273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.532151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.532691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.633724 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lazy-loading 'services' on Instance uuid d7660543-f5b0-4906-9ab5-85d403c42545 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:07.928772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-60870fb2-d3bc-4f9a-8b2b-546f486b64af tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments/4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745" status: 202 len: 0 microversion: 2.1 time: 0.410724 Sep 22 13:16:07.929636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 475/894] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:16:07 2021] DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments/4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:07.938230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:07.940514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:07.946798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.947502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.948481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:07.948927 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:07.983471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b4d36634-980b-4809-85d2-ea817f511437 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049185 Sep 22 13:16:07.988450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 476/895] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:07 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:08.246344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-a07d7adc-f160-41fc-a780-66286213cfa9 req-f07129aa-9e86-4a5b-abd5-78ba0b03d8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:08.249000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:08.249000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:16:08.257482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a07d7adc-f160-41fc-a780-66286213cfa9 req-f07129aa-9e86-4a5b-abd5-78ba0b03d8f9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:08.258006 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-a07d7adc-f160-41fc-a780-66286213cfa9 req-f07129aa-9e86-4a5b-abd5-78ba0b03d8f9 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:08.273232 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-a07d7adc-f160-41fc-a780-66286213cfa9 req-f07129aa-9e86-4a5b-abd5-78ba0b03d8f9 service nova] Creating event network-changed:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:16:08.279678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-a07d7adc-f160-41fc-a780-66286213cfa9 req-f07129aa-9e86-4a5b-abd5-78ba0b03d8f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Sep 22 13:16:08.280495 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 477/896] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:08.996678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:08.997707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:09.004379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:09.008004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:09.008004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:09.008004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:09.038116 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-569b9c3b-ba45-44bc-b5e4-9f7817d0a6c5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Sep 22 13:16:09.038678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 478/897] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:08 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:09.843274 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cbd22924-2921-4611-b2ed-833eabf75d5c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 14 microversion: 2.20 time: 2.557142 Sep 22 13:16:09.847220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 420/898] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:07 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 14 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:10.050984 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:10.051949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:10.067692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:10.067692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:10.067692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:10.067692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:10.104602 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4ef14c97-928a-44db-b3f0-6ef018606fbc tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057945 Sep 22 13:16:10.107956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 479/899] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:10 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:11.095798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:11.097699 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:11.103168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:11.103645 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:11.104416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:11.104845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:11.117613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:11.118613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:11.134587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:11.135040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:11.135850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:11.136283 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:11.180716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-74384104-23f3-4778-b690-66fe35cf77d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066904 Sep 22 13:16:11.181453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 480/900] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:11 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:12.192401 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:12.193314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:12.199059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:12.199545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:12.200315 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:12.200746 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:12.230811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e93d52b7-a7ad-4275-a669-dac9c9167dbd tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Sep 22 13:16:12.231386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 481/901] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:12 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:13.071574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2cad9ced-1acc-4c44-aafd-32c29d32226e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 15025 microversion: 2.20 time: 2.220060 Sep 22 13:16:13.072202 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 421/902] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:10 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 15025 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:13.242521 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:13.243462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:13.249475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.249920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.250732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.251167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.284392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-90bdafee-c821-4627-a52d-d01c2fbdfbd5 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Sep 22 13:16:13.284887 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 482/903] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:13 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:13.491802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:13.492824 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:13.499698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.500161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.501563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.502210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.533135 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-14a42f4a-97c2-4f42-85db-568b1028841f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045674 Sep 22 13:16:13.533724 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 422/904] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:13 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:16:13.635208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:13.635733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:13.641837 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.642291 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.643139 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:13.643603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:13.669120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:16:14.083619 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:14.084465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:14.090534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.090986 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.091786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.092219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.103078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-88bdf960-e680-4907-b77a-f2708a8eb919 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 204 len: 0 microversion: 2.1 time: 0.471279 Sep 22 13:16:14.103717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 483/905] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:16:13 2021] DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:16:14.113242 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:14.113937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:14.121610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.122061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.122974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.123936 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.184575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d6eba05e-5aaf-4298-8270-88e0613327b4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 17931 microversion: 2.20 time: 0.104763 Sep 22 13:16:14.185329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 423/906] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:14 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 17931 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:14.269871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:14.277699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6b2441bf-59bf-4075-820d-d0217544aa9a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.169331 Sep 22 13:16:14.284985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 484/907] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:14 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:14.296496 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:14.297828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:14.304428 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.304881 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.305717 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.306152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.337898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b847ec4c-3a9a-4193-ac5c-6a3913aff449 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045535 Sep 22 13:16:14.338379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 424/908] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:16:14 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:16:14.348859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:14.349386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:14.356685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.357252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.358038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:14.358472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:14.444098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] HTTP exception thrown: Instance d7660543-f5b0-4906-9ab5-85d403c42545 is not attached to volume 4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745 Sep 22 13:16:14.444770 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Returning 404 to user: Instance d7660543-f5b0-4906-9ab5-85d403c42545 is not attached to volume 4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745 {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:16:14.445701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b6793102-01ce-4b5f-8373-a147b578a294 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments/4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745" status: 404 len: 154 microversion: 2.1 time: 0.101425 Sep 22 13:16:14.447010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 485/909] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:16:14 2021] DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545/os-volume_attachments/4d0bdcc9-2b3c-4bb4-aeca-f10d7a18c745 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:16:15.197045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:15.197961 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:15.204617 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:15.205179 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:15.205840 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:15.206275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:15.297127 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:15.298471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:15.307463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:15.307917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:15.308706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:15.309155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:15.440557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:15.448551 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0b6aa4bc-ffea-4d9f-b4e8-10e6bc29cbf1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.155529 Sep 22 13:16:15.449144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 486/910] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:15 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:16.466062 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:16.466769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:16.473456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:16.473894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:16.474668 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:16.475093 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:16.612436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:16.620195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-773b49c4-2d0a-4fdd-a061-2d3e6715405c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.157652 Sep 22 13:16:16.620778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 487/911] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:16 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:17.638430 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:17.639078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:17.645506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:17.645961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:17.646744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:17.647455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:17.775645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:17.784078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-50e81bac-f99f-4334-8044-bf064f7607f2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.149581 Sep 22 13:16:17.784677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 488/912] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:17 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:17.970952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e51116dc-bc27-419a-8911-7b413fb26733 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 21965 microversion: 2.20 time: 2.777448 Sep 22 13:16:17.972016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 425/913] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:15 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 21965 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:18.806481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:18.807775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:18.821055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:18.821851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:18.823272 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:18.824103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:18.983298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:18.985461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:18.992909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:18.993514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:18.994376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:18.994895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:19.002024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:19.009748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5477251f-92f7-4e0a-8b90-8170b34e0cc7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.210595 Sep 22 13:16:19.010364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 489/914] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:18 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:19.058503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:19.058999 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:19.064942 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:19.065427 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:19.066253 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:19.066699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:19.091783 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:16:19.103800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8a7b5095-9b5a-4fb1-b636-f9c1b6262015 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 23797 microversion: 2.20 time: 0.124466 Sep 22 13:16:19.105201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 426/915] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:18 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 23797 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:19.465309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-64e26eef-b901-4a13-81be-0c8db32729b3 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 204 len: 0 microversion: 2.1 time: 0.410164 Sep 22 13:16:19.466004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 490/916] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:16:19 2021] DELETE /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 13:16:19.475190 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:19.476182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:19.482873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:19.483459 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:19.484311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:19.484900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:19.734829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:19.742888 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-39ad45cc-01b9-4d97-be5d-12fec05bf809 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1555 microversion: 2.1 time: 0.271663 Sep 22 13:16:19.744095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 427/917] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:19 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:20.028361 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:20.029395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:20.035511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.035975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.036766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.037234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.116143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:20.117063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:20.123683 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.124118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.124894 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.125816 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.214354 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-518be3cc-4494-462d-bf73-66ce892b997c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 24783 microversion: 2.20 time: 0.101833 Sep 22 13:16:20.215003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 428/918] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:20 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 24783 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:20.230574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:20.238800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ea05a869-0aff-4270-a503-06bfb2039ee1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1674 microversion: 2.1 time: 0.214523 Sep 22 13:16:20.239388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 491/919] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:20 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:20.761948 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:20.763607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:20.773287 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.774527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.775961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.776587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.880807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-63b07779-d8e7-4827-b9d5-da42ea1a563e req-555def74-99f2-4f6d-9f2b-e367818ff7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34469eaa-a287-41e5-a5cd-ad889e389ada", "name": "network-vif-deleted", "tag": "f3ee028d-6a0d-4aa7-823b-d96fde18de61"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:20.882492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:20.882492 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:20.897034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-63b07779-d8e7-4827-b9d5-da42ea1a563e req-555def74-99f2-4f6d-9f2b-e367818ff7eb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:20.899097 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-63b07779-d8e7-4827-b9d5-da42ea1a563e req-555def74-99f2-4f6d-9f2b-e367818ff7eb service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:20.929449 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-63b07779-d8e7-4827-b9d5-da42ea1a563e req-555def74-99f2-4f6d-9f2b-e367818ff7eb service nova] Creating event network-vif-deleted:f3ee028d-6a0d-4aa7-823b-d96fde18de61 for instance 34469eaa-a287-41e5-a5cd-ad889e389ada on hv-cinder-81000 Sep 22 13:16:20.937445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-63b07779-d8e7-4827-b9d5-da42ea1a563e req-555def74-99f2-4f6d-9f2b-e367818ff7eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330023 Sep 22 13:16:20.941309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 429/920] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:20.994599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:21.014848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3416249c-a2a9-40b9-89e7-a0659ad474e7 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1555 microversion: 2.1 time: 0.256908 Sep 22 13:16:21.019098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 492/921] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:20 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:21.227462 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:21.229203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:21.235886 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:21.237623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:21.237623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:21.237623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:21.257091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:21.257697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:21.270693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:21.272095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:21.272526 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:21.272954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:21.322613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f4c11b57-1e2d-4045-b30f-c3228e5c818a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 25397 microversion: 2.20 time: 0.099602 Sep 22 13:16:21.328723 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 430/922] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:21 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 25397 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:21.334746 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:21.335575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:21.337377 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lazy-loading 'fault' on Instance uuid 34469eaa-a287-41e5-a5cd-ad889e389ada {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:21.378059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:21.387502 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-68255539-e31c-475b-bbe1-575da0b9b832 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 200 len: 1327 microversion: 2.1 time: 0.134750 Sep 22 13:16:21.388971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 493/923] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:21 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:22.037311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:22.038279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:22.044891 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.045932 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.047833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.048496 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.217703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:22.226077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-69d38531-2c18-41cd-a05c-c89ad1d19588 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1555 microversion: 2.1 time: 0.193043 Sep 22 13:16:22.226567 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 431/924] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:22 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:22.334852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:22.340108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:22.344480 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.344912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.345869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.346296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.406096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:22.407547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:22.414558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.414558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.414558 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.414893 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.427598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-614fd788-b412-4aa6-8bd9-42b66b18ecfa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 26577 microversion: 2.20 time: 0.096861 Sep 22 13:16:22.428286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 494/925] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:22 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 26577 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:22.428607 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. Sep 22 13:16:22.429233 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:16:22.430071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-416442e7-aaed-410e-bec8-016a1f7fce99 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 404 len: 111 microversion: 2.1 time: 0.027766 Sep 22 13:16:22.430614 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 432/926] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:22 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:16:22.439600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-29de6048-381f-4ea0-8f90-ac1cf2db8368 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '.version_select at 0x7fa7181d0670>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:22.563955 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-29de6048-381f-4ea0-8f90-ac1cf2db8368 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-674324468" status: 202 len: 0 microversion: 2.1 time: 0.128294 Sep 22 13:16:22.570027 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 495/927] 10.222.0.43 () {58 vars in 1218 bytes} [Wed Sep 22 13:16:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-674324468 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:22.624670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:22.625355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:22.632431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.632880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.634117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.635579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.775422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lazy-loading 'services' on Instance uuid 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:22.957969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f18d21da-c7b6-4c13-a4c7-a9cdf1f45c7d req-5dfb961a-0dae-4190-8c55-3edcea270993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7660543-f5b0-4906-9ab5-85d403c42545", "name": "network-vif-deleted", "tag": "198d6688-72fa-45fc-bcd9-c314e7fa6b0e"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:22.960207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:22.960207 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:16:22.969653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f18d21da-c7b6-4c13-a4c7-a9cdf1f45c7d req-5dfb961a-0dae-4190-8c55-3edcea270993 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:22.970106 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f18d21da-c7b6-4c13-a4c7-a9cdf1f45c7d req-5dfb961a-0dae-4190-8c55-3edcea270993 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:22.981402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f18d21da-c7b6-4c13-a4c7-a9cdf1f45c7d req-5dfb961a-0dae-4190-8c55-3edcea270993 service nova] Creating event network-vif-deleted:198d6688-72fa-45fc-bcd9-c314e7fa6b0e for instance d7660543-f5b0-4906-9ab5-85d403c42545 on hv-cinder-81000 Sep 22 13:16:22.987661 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f18d21da-c7b6-4c13-a4c7-a9cdf1f45c7d req-5dfb961a-0dae-4190-8c55-3edcea270993 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Sep 22 13:16:22.989010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 496/928] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:23.039565 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c99e077c-788f-4e8c-ba1e-d88cd8d18744 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50/os-volume_attachments/4224002f-0716-4510-94a4-b42cd6d1b6eb" status: 202 len: 0 microversion: 2.1 time: 0.418656 Sep 22 13:16:23.043301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 433/929] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:16:22 2021] DELETE /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50/os-volume_attachments/4224002f-0716-4510-94a4-b42cd6d1b6eb => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:23.243894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:23.244599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:23.251394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:23.251865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:23.252814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:23.253420 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:23.284791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:23.285481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:23.286101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lazy-loading 'fault' on Instance uuid d7660543-f5b0-4906-9ab5-85d403c42545 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:23.332079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280f27d698654a4f93ef361dd022de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b37942aed94a0193ab222fd05836ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:23.339289 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-61e19068-36f3-4190-b6e3-7683747f00d2 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 200 len: 1349 microversion: 2.1 time: 0.099466 Sep 22 13:16:23.348523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 497/930] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:23 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:23.448305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:23.448305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:23.449860 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:23.450720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:23.451828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:23.456417 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:23.555745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-61447aec-9742-4e8b-a501-fb5160a86919 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 27414 microversion: 2.20 time: 0.117282 Sep 22 13:16:23.556686 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 434/931] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:23 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 27414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:23.587871 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: .version_select at 0x7fa7181b50d0>, body: {"keypair": {"name": "tempest-keypair-1890736008"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:23.613445 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:23.617610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:24.164688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:24.169345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:24.183701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee2bfe26-9d62-4e7f-9385-422ec5c23103 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.610776 Sep 22 13:16:24.184296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 498/932] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Sep 22 13:16:23 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:24.202186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:24.202789 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:24.210165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.210599 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.211369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.211827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.240391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:16:24.356170 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:24.356780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] [instance: d7660543-f5b0-4906-9ab5-85d403c42545] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:24.365726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.366347 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.367348 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.367812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.383338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] HTTP exception thrown: Instance d7660543-f5b0-4906-9ab5-85d403c42545 could not be found. Sep 22 13:16:24.383951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Returning 404 to user: Instance d7660543-f5b0-4906-9ab5-85d403c42545 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:16:24.384771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-39d872c4-646b-4862-af36-ae5f631c2b8b tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545" status: 404 len: 111 microversion: 2.1 time: 0.032395 Sep 22 13:16:24.385311 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 499/933] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:24 2021] GET /compute/v2.1/servers/d7660543-f5b0-4906-9ab5-85d403c42545 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:16:24.394303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-489f160d-459b-4dab-8a60-1ea33b264e84 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] Calling method '.version_select at 0x7fa7181b5a60>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:24.490527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-489f160d-459b-4dab-8a60-1ea33b264e84 tempest-TestMinimumBasicScenario-1654440286 tempest-TestMinimumBasicScenario-1654440286-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1740085743" status: 202 len: 0 microversion: 2.1 time: 0.099951 Sep 22 13:16:24.491910 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 500/934] 10.222.0.43 () {58 vars in 1272 bytes} [Wed Sep 22 13:16:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1740085743 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:24.567993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:24.568913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:24.574808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.576059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.576059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.576459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.628271 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fbe74378-f6e5-4443-8d2e-049032f4f3af tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 204 len: 0 microversion: 2.1 time: 0.430298 Sep 22 13:16:24.628853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 435/935] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:16:24 2021] DELETE /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:16:24.643054 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:24.644322 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:24.649895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.650337 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.651419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:24.651537 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:24.666001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4f975d6d-5d6d-4a58-a0f2-09682ae086cf tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 27825 microversion: 2.20 time: 0.100778 Sep 22 13:16:24.666001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 501/936] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:24 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 27825 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:24.832075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:24.843185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3d17175a-6926-41d9-9af3-f9dc2dcc6cee tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1514 microversion: 2.1 time: 0.208467 Sep 22 13:16:24.844181 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 436/937] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:24 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:25.678900 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:25.679912 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:25.686769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:25.688204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:25.689180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:25.689587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:25.768768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4d5dccfa-beb3-4034-8482-fd3b67466c65 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28070 microversion: 2.20 time: 0.093664 Sep 22 13:16:25.769432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 502/938] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:25 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28070 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:25.866477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:25.867777 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:25.885684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:25.885684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:25.885684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:25.885684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:26.017499 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:26.025349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5afdc906-d6c4-4156-a700-7d1fb2fa177f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1514 microversion: 2.1 time: 0.163880 Sep 22 13:16:26.025923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 437/939] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:25 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:26.781748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:26.783554 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:26.790147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:26.790596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:26.791620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:26.792223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:26.873309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e31a6f08-1311-46a8-8744-450aac8f30f0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28256 microversion: 2.20 time: 0.095890 Sep 22 13:16:26.873789 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 503/940] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:26 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28256 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:27.042593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:27.043360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:27.052877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:27.053333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:27.054204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:27.054666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:27.535530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-ad465e3b-cec0-48fd-9bb5-004fa1cacfcd req-603b16ba-7d45-489d-a2c9-88418e6e7b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50", "name": "network-vif-deleted", "tag": "bbbb0eab-72e6-4c66-ba19-cc778571757d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:27.537259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:27.537259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:16:27.552913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ad465e3b-cec0-48fd-9bb5-004fa1cacfcd req-603b16ba-7d45-489d-a2c9-88418e6e7b5e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:27.553360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ad465e3b-cec0-48fd-9bb5-004fa1cacfcd req-603b16ba-7d45-489d-a2c9-88418e6e7b5e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:27.569972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-ad465e3b-cec0-48fd-9bb5-004fa1cacfcd req-603b16ba-7d45-489d-a2c9-88418e6e7b5e service nova] Creating event network-vif-deleted:bbbb0eab-72e6-4c66-ba19-cc778571757d for instance 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 on hv-cinder-81000 Sep 22 13:16:27.573605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-ad465e3b-cec0-48fd-9bb5-004fa1cacfcd req-603b16ba-7d45-489d-a2c9-88418e6e7b5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041944 Sep 22 13:16:27.574852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 504/941] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:27.720644 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:27.729262 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-16d810a2-e955-4a14-9be3-2f29ebbf4939 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1514 microversion: 2.1 time: 0.690936 Sep 22 13:16:27.729842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 438/942] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:27 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1514 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:27.886497 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:27.887676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:27.902811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:27.902811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:27.902811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:27.902811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:27.967893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d61820e2-ef1b-4a9d-9515-dc6f051fa0ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28256 microversion: 2.20 time: 0.085296 Sep 22 13:16:27.969498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 505/943] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:27 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28256 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:28.009595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1604694215", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7ff256e-94df-44a6-b96c-3d0c6896f093"}], "security_groups": [{"name": "tempest-securitygroup--128559222"}], "key_name": "tempest-keypair-1890736008", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:28.224534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] validate_networks() for [('f7ff256e-94df-44a6-b96c-3d0c6896f093', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:16:28.768533 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:28.770193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:28.797804 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:28.798953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:28.801285 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:28.806576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:28.877529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:28.877985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:28.878448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lazy-loading 'fault' on Instance uuid 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:28.933637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:28.957681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-20ff07af-e7a0-4bda-a136-72dba1b25157 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 200 len: 1309 microversion: 2.1 time: 0.211255 Sep 22 13:16:28.958272 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 506/944] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:28 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:28.982506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:28.993523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:29.005140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.005907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:29.006966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.007626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:29.107721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-684a5b64-2f9f-455a-bcc0-401134372481 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28547 microversion: 2.20 time: 0.128125 Sep 22 13:16:29.107721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 507/945] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:28 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28547 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:29.307865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:16:29.310191 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:16:29.310899 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:16:29.311576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:16:29.312796 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:16:29.324692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.326287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:29.328476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.329191 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:29.350407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:29.359555 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Getting quotas for user 1874f2072dc6484287af0c34360a1acd and project 3d0eaec60ee64de8bef900efc8811d07. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:29.371289 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:16:29.373865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:16:29.532175 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fba900bd-a61c-4a2a-ad03-aa8fb39b5eb5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.527468 Sep 22 13:16:29.532786 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 439/946] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:16:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:16:29.544136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86e50a78-2aea-4c82-aa63-9fdda94a4143 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:29.544847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-86e50a78-2aea-4c82-aa63-9fdda94a4143 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:29.627346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-86e50a78-2aea-4c82-aa63-9fdda94a4143 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:29.638706 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-86e50a78-2aea-4c82-aa63-9fdda94a4143 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1238 microversion: 2.1 time: 0.097884 Sep 22 13:16:29.643078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 508/947] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:29 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:29.979364 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:29.981087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:29.993258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.993258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:29.993258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:29.993258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:30.008654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] HTTP exception thrown: Instance 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 could not be found. Sep 22 13:16:30.009130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Returning 404 to user: Instance 9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:16:30.009660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-79f7c0eb-5f34-4fe5-aea1-ed2cda4c7fea tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50" status: 404 len: 111 microversion: 2.1 time: 0.034105 Sep 22 13:16:30.014376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 440/948] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:29 2021] GET /compute/v2.1/servers/9f9bdc4d-7c77-4a72-a23a-dfb6a0777b50 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:16:30.118239 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:30.119405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:30.127485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:30.132416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:30.132416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:30.132416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:30.215839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3fda8175-510d-4fda-9ba9-fcd4c50c0f1f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28715 microversion: 2.20 time: 0.101113 Sep 22 13:16:30.216489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 509/949] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:30 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28715 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:30.665823 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-de36bbc9-a15b-434b-a8ef-7497e41fb1fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:30.668228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-de36bbc9-a15b-434b-a8ef-7497e41fb1fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:30.765915 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-de36bbc9-a15b-434b-a8ef-7497e41fb1fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:30.775506 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-de36bbc9-a15b-434b-a8ef-7497e41fb1fd tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1238 microversion: 2.1 time: 0.120455 Sep 22 13:16:30.787467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 441/950] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:30 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:31.238392 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:31.241569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:31.286274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:31.288600 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:31.292844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:31.294129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:31.794873 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:31.795623 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:31.802791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:31.803243 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:31.804078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:31.804512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:31.990862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:32.016624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-53722987-6916-4b36-8fb7-b58e688bab8d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1234 microversion: 2.1 time: 0.225822 Sep 22 13:16:32.017936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 442/951] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:31 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1234 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:33.042491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:33.044681 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:33.054552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:33.054995 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:33.055900 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:33.056325 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:33.173660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:33.191400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0b3a58df-fc35-4b8f-90e5-bee934b368ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1234 microversion: 2.1 time: 0.157455 Sep 22 13:16:33.197448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 443/952] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:33 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1234 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:33.785396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d556b920-359c-43ef-96ab-f8e5f4ac7d4a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28715 microversion: 2.20 time: 2.559655 Sep 22 13:16:33.786717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 510/953] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:31 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28715 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:34.229173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:34.229831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:34.237169 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:34.237608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:34.238811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:34.239851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:34.343803 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:34.352615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-28ae01ad-6104-4ef7-811f-fd02443532ff tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1290 microversion: 2.1 time: 0.127726 Sep 22 13:16:34.353853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 444/954] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:34 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:34.798499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:34.800485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:34.812994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:34.817638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:34.818751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:34.820699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:34.893647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5d8f4e34-76fb-45d3-bf79-f3b28250e6fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28715 microversion: 2.20 time: 0.099441 Sep 22 13:16:34.898722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 511/955] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:34 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28715 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:35.369728 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:35.372335 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:35.433993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:35.435980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:35.438092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:35.444155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:35.579302 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:35.597640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9f9f6915-f3c0-483e-97d4-db6bb6551d3c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1296 microversion: 2.1 time: 0.231158 Sep 22 13:16:35.598075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 445/956] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:35 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1296 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:35.908113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:35.909556 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:35.923527 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:35.924088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:35.924901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:35.925329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:36.005886 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7c2d7d25-32db-4e17-a813-c34b54f5d6e7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 28869 microversion: 2.20 time: 0.102706 Sep 22 13:16:36.007625 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 512/957] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:35 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 28869 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:36.614673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:36.615304 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:36.621427 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:36.627629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:36.627629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:36.627629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:36.841183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:36.854445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-819b7117-0569-4cfa-8458-7c05d8dd859e tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.242878 Sep 22 13:16:36.856875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 446/958] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:36 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:37.020328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:37.020328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:37.048346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:37.048804 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:37.049604 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:37.050051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:37.193984 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-82bd53b1-6145-424d-b98b-e65661f978ad tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 31227 microversion: 2.20 time: 0.179671 Sep 22 13:16:37.200167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 513/959] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:37 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 31227 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:37.870885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:37.872123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:37.889476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:37.890223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:37.891210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:37.892133 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:38.209747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:38.212741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:38.214061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:38.218948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dc15dfd9-afbf-4a4a-964d-a86c1591f177 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.351536 Sep 22 13:16:38.220197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 447/960] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:37 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:38.223403 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:38.224652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:38.225678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:38.226744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:38.566930 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-de7fa596-7ff2-4cbf-901c-61f8c2495253 req-48ddc6cd-bbff-408d-a358-a34fd1753b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53b0e58-00af-455d-992d-25020215286d", "tag": "6a3f99ba-d71c-4230-ae3c-9417e9cad085"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:38.574331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:38.574331 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:38.595186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-de7fa596-7ff2-4cbf-901c-61f8c2495253 req-48ddc6cd-bbff-408d-a358-a34fd1753b35 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:38.595872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-de7fa596-7ff2-4cbf-901c-61f8c2495253 req-48ddc6cd-bbff-408d-a358-a34fd1753b35 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:38.610205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-de7fa596-7ff2-4cbf-901c-61f8c2495253 req-48ddc6cd-bbff-408d-a358-a34fd1753b35 service nova] Creating event network-changed:6a3f99ba-d71c-4230-ae3c-9417e9cad085 for instance e53b0e58-00af-455d-992d-25020215286d on hv-cinder-81000 Sep 22 13:16:38.617411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-de7fa596-7ff2-4cbf-901c-61f8c2495253 req-48ddc6cd-bbff-408d-a358-a34fd1753b35 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059581 Sep 22 13:16:38.618629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 448/961] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:16:39.236815 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:39.237511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:39.246882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:39.252684 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:39.253711 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:39.254334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:39.527273 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:39.543074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-75c5851a-311c-4eb3-9c72-76612608158f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.310119 Sep 22 13:16:39.543769 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 449/962] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:39 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:40.160861 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a1d79670-5384-4d0b-8cc5-ad97487c8907 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 34948 microversion: 2.20 time: 1.952038 Sep 22 13:16:40.162594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 514/963] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:38 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 34948 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:40.561554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:40.562198 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:40.569395 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:40.569923 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:40.570715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:40.571547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:40.732374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:40.741842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c0ce88c5-8371-4b00-af50-bd4e1484a8ec tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.184625 Sep 22 13:16:40.743070 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 450/964] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:40 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:41.176787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:41.177976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:41.185702 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:41.186778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:41.188742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:41.189268 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:41.294635 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-492c9783-9a9f-45d0-af72-6f994cd7352f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 35978 microversion: 2.20 time: 0.121647 Sep 22 13:16:41.296957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 515/965] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:41 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 35978 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:41.421842 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1745488065", "imageRef": "49bcee19-65b1-4310-9529-cfcfcb088ab4", "flavorRef": "452", "networks": [{"uuid": "88a73b91-5979-401e-ac30-5b2fa30cb9ce"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:41.482315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] validate_networks() for [('88a73b91-5979-401e-ac30-5b2fa30cb9ce', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:16:41.760775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:41.761740 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:41.770136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:41.771334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:41.772395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:41.773031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:42.104472 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:42.112801 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0d580545-5f89-4e28-98a5-92fc6edb3952 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.356530 Sep 22 13:16:42.113402 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 516/966] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:41 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:42.116663 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:16:42.117798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:16:42.118913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:16:42.120166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:16:42.120759 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:16:42.131915 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:42.132390 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:42.133272 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:42.133895 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:42.153412 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Getting quotas for project 2009da3841b14ba69e6be541cc0ec136. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:42.158121 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Getting quotas for user 77151483b3db49db9576b812654d46ca and project 2009da3841b14ba69e6be541cc0ec136. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:42.170601 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:16:42.173425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49bcee19-65b1-4310-9529-cfcfcb088ab4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:16:42.306460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:42.308397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:42.315070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:42.316126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:42.317154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:42.317938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:42.397721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9719f00f-55b3-4eab-bc9d-56ec980f4cc1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 37501 microversion: 2.20 time: 0.093262 Sep 22 13:16:42.399463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 517/967] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:42 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 37501 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:42.407117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-85a09863-0930-469a-95b2-f01a4cf3116f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989596 Sep 22 13:16:42.409433 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 451/968] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:16:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:16:42.422305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a5962372-e818-4717-ba8f-5cfa3c91c3ef tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:42.423892 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a5962372-e818-4717-ba8f-5cfa3c91c3ef tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:42.723609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a5962372-e818-4717-ba8f-5cfa3c91c3ef tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:42.736997 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a5962372-e818-4717-ba8f-5cfa3c91c3ef tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1219 microversion: 2.1 time: 0.321632 Sep 22 13:16:42.753322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 518/969] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:42 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:43.130008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:43.130597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:43.137058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.137939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.139615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.141529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.351547 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:43.363725 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5fb59afc-6aa0-4c1c-b0eb-c9b723e3f525 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.237478 Sep 22 13:16:43.372698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 452/970] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:43 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:43.409762 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:43.410690 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:43.418851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.419296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.420986 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.421687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.512151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-95d0fa96-a293-44a4-8f86-2290b24dcd96 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 38274 microversion: 2.20 time: 0.105720 Sep 22 13:16:43.513102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 519/971] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:43 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 38274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:43.777178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:43.777864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:43.789810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.790336 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.791113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:43.791577 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:43.865229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:43.872845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-012983d8-3488-465a-9e52-867eca19d642 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1223 microversion: 2.1 time: 0.100225 Sep 22 13:16:43.874140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 453/972] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:43 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:44.394795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:44.402074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:44.439357 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.440053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.440615 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.441043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.526379 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:44.531201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:44.541374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.542085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.543349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.543915 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.621272 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a290f8c4-dcfa-494d-8872-3e7b86730af9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 38274 microversion: 2.20 time: 0.098971 Sep 22 13:16:44.623193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 454/973] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:44 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 38274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:44.892100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:44.892874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:44.896138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:44.907840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8ce6d8ac-b5b4-4d34-a12e-89adecf92459 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.519308 Sep 22 13:16:44.908437 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 520/974] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:44 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:44.917687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.917687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.917687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:44.917687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:44.990625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:44.998911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5a4ef753-e5b3-422b-a1a5-3463dc887ca1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1271 microversion: 2.1 time: 0.111157 Sep 22 13:16:45.000411 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 455/975] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:44 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:45.348416 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Action: 'create', calling method: .version_select at 0x7fa7181b58b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-289619331"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:45.367576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:45.372051 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for user bc4e105d110b4129b0765f02a4dbde7f and project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:45.611397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:16:45.615780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for user bc4e105d110b4129b0765f02a4dbde7f and project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'key_pairs'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:16:45.631307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b523d1b6-7e55-4d28-9d02-d031e7f5311f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.593544 Sep 22 13:16:45.631993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 521/976] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Sep 22 13:16:45 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:45.643400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:45.644305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:45.651084 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:45.651545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:45.652589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:45.653186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:45.723301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b8d70a17-fc9a-4237-8dbe-b771785ba546 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 38274 microversion: 2.20 time: 0.090728 Sep 22 13:16:45.727698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 456/977] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:45 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 38274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:16:45.928183 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:45.929079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:45.936944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:45.937418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:45.938214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:45.938656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.022311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:46.023041 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:46.031036 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:46.032076 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.033269 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:46.033948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.191542 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:46.199791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4d945f61-7607-475f-87a3-f70eca1f78b9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.182523 Sep 22 13:16:46.200378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 457/978] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:46 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:46.214165 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:46.223555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1d2bee4b-3a7a-4ec1-a26e-5757f2421ae2 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.301468 Sep 22 13:16:46.224139 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 522/979] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:45 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:46.626115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-10885686-14d7-46ea-b5a3-5b3762c9d36d req-91cf05ae-04ff-4ef5-9949-d0a5d1a13692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53b0e58-00af-455d-992d-25020215286d", "name": "network-vif-plugged", "status": "completed", "tag": "6a3f99ba-d71c-4230-ae3c-9417e9cad085"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:46.629742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:46.629742 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:46.649797 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-10885686-14d7-46ea-b5a3-5b3762c9d36d req-91cf05ae-04ff-4ef5-9949-d0a5d1a13692 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:46.653403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-10885686-14d7-46ea-b5a3-5b3762c9d36d req-91cf05ae-04ff-4ef5-9949-d0a5d1a13692 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.675290 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-10885686-14d7-46ea-b5a3-5b3762c9d36d req-91cf05ae-04ff-4ef5-9949-d0a5d1a13692 service nova] Creating event network-vif-plugged:6a3f99ba-d71c-4230-ae3c-9417e9cad085 for instance e53b0e58-00af-455d-992d-25020215286d on hv-cinder-81000 Sep 22 13:16:46.681541 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-10885686-14d7-46ea-b5a3-5b3762c9d36d req-91cf05ae-04ff-4ef5-9949-d0a5d1a13692 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224489 Sep 22 13:16:46.683763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 458/980] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:46.746899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:46.750753 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:46.762775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:46.767335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.768538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:46.769949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:46.852162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee075b55-97d1-4ed8-9ac5-72f6640741ea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 38287 microversion: 2.20 time: 0.119734 Sep 22 13:16:46.852813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 523/981] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:46 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 38287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:47.220875 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:47.222534 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:47.230223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.230885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.231758 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.232472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.241776 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:47.243347 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:47.255226 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.258797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.259853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.260468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.487002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:47.495411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1f9502c5-c7c2-4637-b8a0-44f322c8c680 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.258418 Sep 22 13:16:47.498444 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 524/982] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:47 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:47.544400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:47.553654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f257ba25-1883-469e-acea-69ac3ef05a4f tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.339059 Sep 22 13:16:47.554763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 459/983] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:47 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:47.620271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-e0e6bea9-291a-45af-a35a-6cfc6899e152 req-e94e6193-6f49-4f2d-a99d-2030064691ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf14087-75d8-421b-9c66-9b1f74525492", "tag": "c567df70-76a0-4af2-8693-d7e886674661"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:47.621779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:47.621779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:16:47.628732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e0e6bea9-291a-45af-a35a-6cfc6899e152 req-e94e6193-6f49-4f2d-a99d-2030064691ed service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.629174 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-e0e6bea9-291a-45af-a35a-6cfc6899e152 req-e94e6193-6f49-4f2d-a99d-2030064691ed service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.641171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-e0e6bea9-291a-45af-a35a-6cfc6899e152 req-e94e6193-6f49-4f2d-a99d-2030064691ed service nova] Creating event network-changed:c567df70-76a0-4af2-8693-d7e886674661 for instance fbf14087-75d8-421b-9c66-9b1f74525492 on hv-cinder-81000 Sep 22 13:16:47.646477 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-e0e6bea9-291a-45af-a35a-6cfc6899e152 req-e94e6193-6f49-4f2d-a99d-2030064691ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029732 Sep 22 13:16:47.647150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 525/984] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:47.864561 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:47.869731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:47.879070 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.881776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.881776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.881776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.965147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8b68d744-90aa-478f-a1c4-ce2a5cbe8981 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 200 len: 38417 microversion: 2.20 time: 0.104648 Sep 22 13:16:47.967979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 460/985] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:47 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 38417 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:16:47.978440 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:47.979089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:47.986292 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.987000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:47.988446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:47.989045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:48.019749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e8163767-4315-4ff8-bedc-84ed1638b698 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/ips" status: 200 len: 152 microversion: 2.20 time: 0.046075 Sep 22 13:16:48.021020 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 526/986] 10.222.0.43 () {60 vars in 1289 bytes} [Wed Sep 22 13:16:47 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:16:48.514420 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:48.515140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:48.526575 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:48.531640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:48.532648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:48.533173 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:48.576752 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:48.578438 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:48.615007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:48.616160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:48.617799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:48.618830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:48.837579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:48.850055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8ba1a0e2-640f-4c8c-b801-4b6a97204aab tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1363 microversion: 2.1 time: 0.339476 Sep 22 13:16:48.851215 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 461/987] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:48 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:48.948671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:48.957333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-35f2d1d0-772f-47d6-bbd5-3218943935f5 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.390064 Sep 22 13:16:48.958462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 527/988] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:48 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:49.869680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:49.870682 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:49.878533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:49.878980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:49.879798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:49.880231 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:49.975821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:49.977035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:49.983398 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:49.984044 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:49.984701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:49.985346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:50.035734 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:50.043410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-04f2b1e6-69dd-4d8a-bb9d-1d0e4b4a671a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1550 microversion: 2.1 time: 0.178306 Sep 22 13:16:50.056533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 462/989] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:49 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:50.063896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:50.064380 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:50.072461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:50.072920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:50.073717 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:50.074152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:50.132001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:50.140717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-765e83eb-f3de-4fae-b30f-a96b94c52372 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.169555 Sep 22 13:16:50.141307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 528/990] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:49 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:50.160951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-134281f9-d2eb-4898-94f6-426465c6f94a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101741 Sep 22 13:16:50.161525 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 463/991] 10.222.0.43 () {58 vars in 1275 bytes} [Wed Sep 22 13:16:50 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:50.644699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:50.645934 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:50.666567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:50.668382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:50.670685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:50.672511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:50.717080 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lazy-loading 'flavor' on Instance uuid 62793f2a-0117-416d-89c6-6c431f18e376 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:16:51.158323 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:51.162950 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:51.165014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.165463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.166624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.167064 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.312853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e4540bc7-36a4-485c-8e22-f4792aeefe74 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 202 len: 0 microversion: 2.20 time: 0.671648 Sep 22 13:16:51.313900 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 529/992] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:16:50 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:16:51.322749 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:51.332033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:51.341903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.342924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.343890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.345064 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.527193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:51.540204 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:51.542824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:51.544703 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a9cb02b-57a1-4b8e-8ce9-a263d62978da tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.226010 Sep 22 13:16:51.545294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 530/993] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:51 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:16:51.599293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:51.600291 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:51.606985 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.607498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.613449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.613904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.651741 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:51.663825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a36ab6fc-e5e0-4d75-a936-e28683a015c9 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.509485 Sep 22 13:16:51.664570 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 464/994] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:51 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:51.697726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb781584-1531-41b8-a57e-ccf532c23c02 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.103488 Sep 22 13:16:51.702807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 531/995] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:51 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:16:51.838342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-bff840d3-a3d9-4d1d-a4e4-9fdf98fdc7b4 req-71433efc-0d81-4854-b32f-afe400e7d30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53b0e58-00af-455d-992d-25020215286d", "tag": "6a3f99ba-d71c-4230-ae3c-9417e9cad085"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:51.839911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:51.839911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:51.847201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-bff840d3-a3d9-4d1d-a4e4-9fdf98fdc7b4 req-71433efc-0d81-4854-b32f-afe400e7d30b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:51.847669 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-bff840d3-a3d9-4d1d-a4e4-9fdf98fdc7b4 req-71433efc-0d81-4854-b32f-afe400e7d30b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:51.859329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-bff840d3-a3d9-4d1d-a4e4-9fdf98fdc7b4 req-71433efc-0d81-4854-b32f-afe400e7d30b service nova] Creating event network-changed:6a3f99ba-d71c-4230-ae3c-9417e9cad085 for instance e53b0e58-00af-455d-992d-25020215286d on hv-cinder-81000 Sep 22 13:16:51.865355 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-bff840d3-a3d9-4d1d-a4e4-9fdf98fdc7b4 req-71433efc-0d81-4854-b32f-afe400e7d30b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195317 Sep 22 13:16:51.865959 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 465/996] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:52.565888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:52.571812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:52.580144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.580906 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.581693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.582130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.681472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:52.682159 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:52.689981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.690437 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.691672 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.692290 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.755568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:52.764163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:52.766346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:52.767735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-403482d9-82a1-4c45-bd32-7895a1fd0b92 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.207676 Sep 22 13:16:52.779342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 532/997] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:52 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:16:52.779342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:52.779342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:52.781071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.781525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.784567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:52.784567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:52.870628 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-792addaa-4820-44d4-a62d-59e9f16dd773 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.100593 Sep 22 13:16:52.871962 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 533/998] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:52 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:16:52.882973 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:52.891134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-18dc008a-b6b3-4470-9e31-190d80d96f03 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.214148 Sep 22 13:16:52.892687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 466/999] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:52 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:53.786854 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:53.787636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:53.793852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.794398 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.795190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.795655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.881913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:53.883030 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:53.891257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.891762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.892780 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.893217 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.942734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:53.951405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:53.953055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:53.954237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e8e6689d-2757-4126-b7ca-a97118634aaa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.171690 Sep 22 13:16:53.954809 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 534/1000] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:53 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:16:53.959324 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:53.959954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:53.966260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.966729 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.967605 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:53.968137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:53.983045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-de0c6b53-536e-41f6-8121-d74f190f821c tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.102520 Sep 22 13:16:53.983045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 467/1001] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:53 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:16:54.105817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:54.114119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f793a5c8-0e2c-42e8-ae76-35f730c865f0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.158283 Sep 22 13:16:54.114763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 535/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:53 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:54.457777 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-c2997efc-5fe3-4579-8830-9e856349dcc5 req-c47cb8d4-1703-4a5f-a7e6-763a0bdf8dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf14087-75d8-421b-9c66-9b1f74525492", "name": "network-vif-plugged", "status": "completed", "tag": "c567df70-76a0-4af2-8693-d7e886674661"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:54.462521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:16:54.462521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:16:54.467704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-c2997efc-5fe3-4579-8830-9e856349dcc5 req-c47cb8d4-1703-4a5f-a7e6-763a0bdf8dab service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:54.468140 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-c2997efc-5fe3-4579-8830-9e856349dcc5 req-c47cb8d4-1703-4a5f-a7e6-763a0bdf8dab service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:54.480158 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-c2997efc-5fe3-4579-8830-9e856349dcc5 req-c47cb8d4-1703-4a5f-a7e6-763a0bdf8dab service nova] Creating event network-vif-plugged:c567df70-76a0-4af2-8693-d7e886674661 for instance fbf14087-75d8-421b-9c66-9b1f74525492 on hv-cinder-81000 Sep 22 13:16:54.485822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-c2997efc-5fe3-4579-8830-9e856349dcc5 req-c47cb8d4-1703-4a5f-a7e6-763a0bdf8dab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Sep 22 13:16:54.491242 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 468/1003] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:54.972893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:54.973662 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:54.980310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:54.980728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:54.981514 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:54.981998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:55.002067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:55.002067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:55.003467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:55.003467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:55.003789 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:55.004046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:55.139796 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:55.147511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:55.149045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:55.150343 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-93fb8a11-627c-4d63-bb4b-bacd67b9a8a9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.181698 Sep 22 13:16:55.150785 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 536/1004] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:54 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:16:55.155500 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:55.156118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:55.159579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-44f3efa5-ccbc-4140-a8d8-1952ebe50287 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.169977 Sep 22 13:16:55.161171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 469/1005] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:54 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:16:55.162525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:55.162990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:55.163880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:55.164315 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:55.293013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:55.301308 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-998ed057-f9e0-41e5-a193-80fd1d7ca8e0 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1319 microversion: 2.1 time: 0.149159 Sep 22 13:16:55.301668 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 537/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:55 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:16:56.170888 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:56.171956 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:56.172569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:56.172766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:56.178852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.179302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.180128 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.180320 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.180566 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.180877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.181710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.182329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.251395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-274eeaca-8cb1-45da-b292-4996f479f340 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.083808 Sep 22 13:16:56.252412 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 538/1007] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:56 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:16:56.315646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:56.319090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:56.319750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:56.324376 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:56.326710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:56.328026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bdab78e3-d9ec-4c96-9166-6a82fcf84c90 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.162678 Sep 22 13:16:56.328616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 470/1008] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:56 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:16:56.331790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.332844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.333676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.334113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.470734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:56.473987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-14c80081-5b38-4611-a4e7-e7a079a3b211 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1509 microversion: 2.1 time: 0.159115 Sep 22 13:16:56.474880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 539/1009] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:16:56 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:16:56.491531 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d16b38-fc04-4f6c-999f-b60cdb68c228", "device": "/dev/sdb"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:56.492615 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:56.500605 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.501389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:56.502498 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:56.502975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:57.262884 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:57.263969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:57.271031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:57.271503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:57.272290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:57.272732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:57.287399 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bbf697ac-3d41-40e8-9778-2dd2ce1cf66d tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "POST /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799454 Sep 22 13:16:57.288464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 471/1010] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:16:56 2021] POST /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:16:57.348765 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:57.349748 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:57.352277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-74f2bd50-0f30-4179-b288-e0aa5ac5860f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.092917 Sep 22 13:16:57.354085 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 540/1011] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:57 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 13:16:57.359335 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:57.360123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:57.361084 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:57.361729 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:57.496456 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:57.505313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:57.506811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:57.508081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e298f59f-8ed2-49f0-8c68-6f460310bef5 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.163757 Sep 22 13:16:57.508694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 472/1012] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:57 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:16:58.365023 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:16:58.365961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:58.373364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:58.373818 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:58.374596 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:58.375037 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:58.526494 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:58.527092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:58.534567 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:58.535183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:58.536089 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:58.536529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:58.668441 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:58.677554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:58.679074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:58.680448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-405187c6-3dd4-47cc-8a7c-80712db92bd1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.157754 Sep 22 13:16:58.681012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 473/1013] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:58 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:16:59.699813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:16:59.701156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:16:59.707280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:59.707766 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:59.708548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:16:59.708980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:16:59.834333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:59.842763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:59.844483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:16:59.845772 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fe75c744-9944-4baa-a7f6-ed7541802839 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.149706 Sep 22 13:16:59.846509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 474/1014] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:16:59 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:00.607774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9abce8cb-1ea3-49fc-bbae-3a70a81a61a3 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 2.184189 Sep 22 13:17:00.607774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 541/1015] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:16:58 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:17:00.864181 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:00.864745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:00.871544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:00.872161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:00.873141 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:00.873578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:01.005419 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:01.014455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:01.016078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:01.017261 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-105e1d06-c85e-473d-802f-0f585258da59 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.157060 Sep 22 13:17:01.017828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 475/1016] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:00 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:01.556189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:01.557265 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:01.564715 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:01.565106 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:01.565879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:01.566314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:01.631971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2fd0e82f-d7e7-42c1-a3d8-ffa687583f0b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 14 microversion: 2.1 time: 0.079341 Sep 22 13:17:01.632634 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 542/1017] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:01 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:17:02.035921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:02.036544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:02.042357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:02.042801 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:02.044186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:02.044619 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:02.181884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:02.190027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:02.191528 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:02.192682 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-90857660-5f5b-4963-a033-c4f3cdf24514 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.160505 Sep 22 13:17:02.193239 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 476/1018] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:02 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:02.647511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:02.647511 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:02.651108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:02.653354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:02.653688 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:02.654130 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:03.211665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:03.212275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:03.218488 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:03.218918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:03.219705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:03.220132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:03.345807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:03.353692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:03.355151 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:03.357595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-73e22e11-6075-476f-93f6-a4e866f432cb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.149472 Sep 22 13:17:03.358156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 477/1019] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:03 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:04.376196 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:04.376852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:04.384423 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:04.384870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:04.385642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:04.386074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:04.510483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:04.519936 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:04.521447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:04.522651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9052d1fd-f509-4435-b593-a02c65468d23 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.150928 Sep 22 13:17:04.523213 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 478/1020] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:04 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:04.767814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e80caffe-e20c-4241-9c0a-f3f34f8bd650 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 17384 microversion: 2.1 time: 2.128295 Sep 22 13:17:04.771501 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 543/1021] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:02 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 17384 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:05.548774 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:05.549381 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:05.555720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:05.556161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:05.556934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:05.557356 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:05.697554 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:05.708649 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:05.710129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:05.711287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-084ee6d9-af9f-4a7e-8c01-70cfeb233f40 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.169432 Sep 22 13:17:05.711865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 479/1022] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:05 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:05.781275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:05.782316 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:05.789016 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:05.789620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:05.790408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:05.790875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:05.868137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-16929879-955e-4a04-8e24-a2e5e33775e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 17960 microversion: 2.1 time: 0.091877 Sep 22 13:17:05.869011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 544/1023] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:05 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 17960 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:06.731791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:06.732375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:06.738150 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:06.738590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:06.739340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:06.739790 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:06.860544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:06.868236 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:06.869704 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:06.870864 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fcda3e26-ca56-478b-87b9-c1a4e4d5e74e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.143366 Sep 22 13:17:06.872573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 480/1024] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:06 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:06.880053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:06.881001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:06.887710 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:06.888181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:06.888954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:06.889382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:07.889908 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:07.890483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:07.897398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:07.897398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:07.898071 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:07.898502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:08.026641 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:08.034998 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:08.036491 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:08.037634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8b85b312-28db-432d-a683-eb45adb5689d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.151584 Sep 22 13:17:08.038184 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 481/1025] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:07 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:09.056300 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:09.056994 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:09.063259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:09.063754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:09.064508 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:09.064934 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:09.189474 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:09.197139 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:09.198611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:09.203606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-17dbae57-f28b-47bc-93bb-ddb9b57eba48 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.147249 Sep 22 13:17:09.203606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 482/1026] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:09 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:09.853899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-985d473e-ad7c-418d-8ed5-3d1a94b0838d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 23803 microversion: 2.1 time: 2.977803 Sep 22 13:17:09.854549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 545/1027] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:06 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 23803 bytes in 2980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:10.220775 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:10.221403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:10.227316 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:10.227802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:10.228665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:10.229164 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:10.356698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:10.364465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:10.365958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:10.367129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-71080dd9-da05-48bd-9bc1-1e505e6d07aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.151017 Sep 22 13:17:10.367716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 483/1028] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:10 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:10.866464 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:10.867568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:10.875014 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:10.875485 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:10.876352 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:10.876867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:10.951664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2ae45ba9-de67-4d52-9d11-63894e69938b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 24771 microversion: 2.1 time: 0.089051 Sep 22 13:17:10.952211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 546/1029] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:10 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 24771 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:11.386233 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:11.387731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:11.394549 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:11.395065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:11.396093 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:11.396763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:11.525996 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:11.536346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:11.538294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:11.539095 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-72d04565-aaa5-44b1-9903-ae1e26f12d76 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1746 microversion: 2.20 time: 0.156575 Sep 22 13:17:11.539691 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 484/1030] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:11 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:11.964034 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:11.965974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:11.973748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:11.974117 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:11.974901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:11.975338 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:12.053853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f12326aa-ced8-4e4d-8b51-2d0a97b582f7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 25841 microversion: 2.1 time: 0.093870 Sep 22 13:17:12.054786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 547/1031] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:11 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 25841 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:12.558634 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:12.564502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:12.585250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:12.585250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:12.585250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:12.585250 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:12.750245 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:12.759855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:12.763073 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:12.764792 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1b5353e9-83b0-4e6e-af4d-7bd2de65c8d9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1746 microversion: 2.20 time: 0.210074 Sep 22 13:17:12.765469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 485/1032] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:12 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:13.066073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:13.067113 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:13.074579 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:13.075012 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:13.076091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:13.076498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:13.173761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-924322314", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-289619331", "security_groups": [{"name": "tempest-secgroup-smoke-1876939705"}], "block_device_mapping_v2": [{"uuid": "e3644a2b-dedc-4f4d-b0fb-d065a141ba2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b2b60ff-ffa7-4f74-a063-d8f4477f3f78"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:13.278381 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] validate_networks() for [('3b2b60ff-ffa7-4f74-a063-d8f4477f3f78', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:17:13.643035 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:17:13.643878 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:17:13.644206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:17:13.644613 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:17:13.645019 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:17:13.655163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:13.655643 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:13.656447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:13.656880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:13.672993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:17:13.676848 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for user bc4e105d110b4129b0765f02a4dbde7f and project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:17:13.741009 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:17:13.743200 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3644a2b-dedc-4f4d-b0fb-d065a141ba2d',volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:17:14.169521 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-914b4d92-a2a4-4d97-b0c0-71fdaaf9db6f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999432 Sep 22 13:17:14.170188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 486/1033] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:17:13 2021] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 13:17:14.175791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:14.181760 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:14.182340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:14.184203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:14.185882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:14.186652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:14.334264 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:14.342312 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:14.343885 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:14.345074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1c192a33-253a-4863-92c1-202fd9d90af4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1746 microversion: 2.20 time: 0.173073 Sep 22 13:17:14.345882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 487/1034] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:14 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:14.349981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-85fdac8d-f555-4ae0-8f72-f21891e538c3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:14.350600 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-85fdac8d-f555-4ae0-8f72-f21891e538c3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:14.404151 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-85fdac8d-f555-4ae0-8f72-f21891e538c3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:14.410750 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-85fdac8d-f555-4ae0-8f72-f21891e538c3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1093 microversion: 2.1 time: 0.064146 Sep 22 13:17:14.412061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 488/1035] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:14 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:14.825559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-52e054ed-049c-4067-957d-ebcff251ee23 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 26796 microversion: 2.1 time: 1.762848 Sep 22 13:17:14.826033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 548/1036] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:13 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 26796 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:14.981003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-ed2ecb9d-1bf1-4292-9e29-1235cf91f452 req-66fbaa63-d76e-4ae0-a888-0ffd590ef409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "name": "network-vif-plugged", "status": "completed", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:14.982564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:14.982564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:17:14.989733 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ed2ecb9d-1bf1-4292-9e29-1235cf91f452 req-66fbaa63-d76e-4ae0-a888-0ffd590ef409 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:14.990387 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ed2ecb9d-1bf1-4292-9e29-1235cf91f452 req-66fbaa63-d76e-4ae0-a888-0ffd590ef409 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.002326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-ed2ecb9d-1bf1-4292-9e29-1235cf91f452 req-66fbaa63-d76e-4ae0-a888-0ffd590ef409 service nova] Creating event network-vif-plugged:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:17:15.007391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-ed2ecb9d-1bf1-4292-9e29-1235cf91f452 req-66fbaa63-d76e-4ae0-a888-0ffd590ef409 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Sep 22 13:17:15.009497 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 489/1037] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:17:15.363977 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:15.364673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:15.371539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.371982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.372735 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.373160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.428827 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:15.429533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:15.437047 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.437490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.438262 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.438690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.513464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:15.516951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:15.521310 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2f39ecad-5349-4ed6-8d80-d9cfd8a6a26d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1143 microversion: 2.1 time: 0.096478 Sep 22 13:17:15.522315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 490/1038] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:15 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:15.525557 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:15.527290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:15.528799 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0e0e9d23-922a-4207-9add-8d5ac2727440 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1746 microversion: 2.20 time: 0.168948 Sep 22 13:17:15.529448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 549/1039] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:15 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:15.837632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:15.838574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:15.845482 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.845925 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:15.857956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:15.857956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:16.538709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:16.539279 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:16.546074 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:16.546520 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:16.547304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:16.547754 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:16.608510 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:16.616124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-01d5df92-37fc-40e8-87c3-2ce0ae16a643 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1143 microversion: 2.1 time: 0.081141 Sep 22 13:17:16.616700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 550/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:16 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:16.621609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:16.622214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:16.628348 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:16.628797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:16.629568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:16.630000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:16.754175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:16.762757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:16.764389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:16.766577 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cd5898cc-24ca-47d4-b8de-38156ad5f4ba tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1746 microversion: 2.20 time: 0.148929 Sep 22 13:17:16.767138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 551/1041] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:16 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:16.904405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ab457f69-a9ac-4a0b-915d-c5c3a5cec01d tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 27756 microversion: 2.1 time: 1.070320 Sep 22 13:17:16.905063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 491/1042] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:15 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 27756 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:17.633493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:17.634129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:17.641460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.645765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.645765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.645765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.718275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:17.725879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f7d5cb83-4279-4433-98c4-5d20079df4cf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1135 microversion: 2.1 time: 0.096235 Sep 22 13:17:17.726458 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 552/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:17 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1135 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:17.786278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:17.787941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:17.795123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.797919 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.797919 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.797919 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.920007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:17.921927 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:17.934717 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.936305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.937798 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:17.938677 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:17.942676 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:17.951287 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:17.952999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:17.954027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-190fc2f9-a6db-446e-a23a-9548b9c9300c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.172575 Sep 22 13:17:17.954597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 492/1044] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:17 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:18.031162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1e47f810-b323-4ca2-8262-610678002449 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28168 microversion: 2.1 time: 0.118134 Sep 22 13:17:18.031983 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 553/1045] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:17 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28168 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:18.741979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:18.742604 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:18.750932 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:18.751703 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:18.752660 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:18.753090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:18.833201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:18.842562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-aac37eac-d6fd-4e53-b7a6-ca4d23b2016a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1209 microversion: 2.1 time: 0.104283 Sep 22 13:17:18.843760 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 493/1046] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:18 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:18.983975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:18.985386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:18.993194 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:18.993944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:18.996295 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:18.996917 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:19.044450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:19.045378 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:19.052063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:19.053130 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:19.054263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:19.054862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:19.240164 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:19.249294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:19.250873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:19.252255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f82fb698-aa4e-45cb-8a51-4877ba47b2d8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.273347 Sep 22 13:17:19.253388 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 554/1047] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:18 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:19.859964 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:19.860932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:19.869469 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:19.870659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:19.871823 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:19.872434 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:20.002919 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:20.012040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4d85c777-d3d1-4988-b857-32d953527044 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1277 microversion: 2.1 time: 0.154806 Sep 22 13:17:20.021697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 555/1048] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:19 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:20.270678 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:20.271499 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:20.277707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:20.278155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:20.278939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:20.279376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:20.427158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:20.437879 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:20.439680 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:20.441105 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8e7913b6-e583-4a06-a0f3-a6dbca84480f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.174839 Sep 22 13:17:20.442296 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 556/1049] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:20 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:21.029509 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:21.030150 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:21.035936 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:21.036382 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:21.037141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:21.037575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:21.165413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:21.172954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4026624c-e6d3-4b44-a0ba-e79161466919 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1277 microversion: 2.1 time: 0.147889 Sep 22 13:17:21.173523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 557/1050] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:21 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:21.378884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fe03951b-0ff5-4570-816f-681a7c238dbb tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28168 microversion: 2.1 time: 2.338858 Sep 22 13:17:21.383063 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 494/1051] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:19 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28168 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:21.459837 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:21.460449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:21.466564 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:21.466983 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:21.467824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:21.468263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:21.694907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:21.708490 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:21.710516 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:21.711905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5c45e3b1-9b2a-4790-9d2b-477d93e74ebe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.255849 Sep 22 13:17:21.723228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 558/1052] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:21 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:22.194308 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:22.195103 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:22.204090 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.204681 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.205573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.206107 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.373341 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-fbf7b6c1-9c82-4563-a096-503879cd4db5 req-c55dcc4a-7884-4459-b53a-44354f25558b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7125b6ac-217a-4c3b-a263-7459bb3268ae", "tag": "95ed0171-069d-4864-a2cc-88942442a595"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:22.378110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:22.378110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:17:22.408351 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fbf7b6c1-9c82-4563-a096-503879cd4db5 req-c55dcc4a-7884-4459-b53a-44354f25558b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.410474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-fbf7b6c1-9c82-4563-a096-503879cd4db5 req-c55dcc4a-7884-4459-b53a-44354f25558b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.442641 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-fbf7b6c1-9c82-4563-a096-503879cd4db5 req-c55dcc4a-7884-4459-b53a-44354f25558b service nova] Creating event network-changed:95ed0171-069d-4864-a2cc-88942442a595 for instance 7125b6ac-217a-4c3b-a263-7459bb3268ae on hv-cinder-81000 Sep 22 13:17:22.450073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-fbf7b6c1-9c82-4563-a096-503879cd4db5 req-c55dcc4a-7884-4459-b53a-44354f25558b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081714 Sep 22 13:17:22.451010 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 559/1053] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:17:22.473008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:22.475181 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:22.476550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:22.484625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-987da5cc-5c00-4316-8632-efa8a0088338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1277 microversion: 2.1 time: 0.294769 Sep 22 13:17:22.485620 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 495/1054] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:22 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:22.486939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.487479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.489034 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.489583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.573893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb2104d7-7169-42bd-808d-d577a04c5155 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28168 microversion: 2.1 time: 0.120002 Sep 22 13:17:22.575256 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 560/1055] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:22 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28168 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:22.730957 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:22.731353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:22.737585 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.738034 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.738829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:22.739737 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:22.893046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:22.903165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:22.905199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:22.906997 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c6a163c8-9fce-42f5-98ca-d5b3bdb43cf4 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.180557 Sep 22 13:17:22.908126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 496/1056] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:22 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:23.508069 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:23.509529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:23.519055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.520571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:23.521895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.522574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:23.587564 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:23.589768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:23.604388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.605635 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:23.606729 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.607455 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:23.708165 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ee6a7746-4e71-45a9-ab6a-2f0cc9cd247a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28459 microversion: 2.1 time: 0.121378 Sep 22 13:17:23.710104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 497/1057] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:23 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28459 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:23.758792 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:23.767205 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b49b9283-7f71-4dba-9518-edfe81d65951 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.268343 Sep 22 13:17:23.768626 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 561/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:23 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:23.927763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:23.928599 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:23.937066 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.937662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:23.938886 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:23.939570 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:24.087281 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:24.097247 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:24.099059 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:24.101373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-327bdedf-b53f-40d7-bd3b-35221f3f75aa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.177825 Sep 22 13:17:24.103850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 498/1059] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:23 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:24.734079 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:24.737178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:24.753550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:24.754005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:24.754795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:24.755230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:24.793822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:24.794581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:24.802847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:24.803416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:24.804529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:24.805106 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:24.848119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-21516399-11ed-4d2c-a1b3-86e8417183a1 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28627 microversion: 2.1 time: 0.131413 Sep 22 13:17:24.850005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 562/1060] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:24 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28627 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:24.985954 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:24.996093 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-f486f1c1-be8d-4c2a-a4ba-7a1db21ab841 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.212087 Sep 22 13:17:24.996719 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 499/1061] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:24 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:25.122104 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:25.122802 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:25.129714 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:25.130157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:25.130931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:25.131475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:25.301263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:25.314149 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:25.316036 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:25.318453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2f3c32ea-aa41-48dc-b332-22ebfef924e9 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.199813 Sep 22 13:17:25.320373 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 563/1062] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:25 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:25.874029 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:25.877122 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:25.890013 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:25.891212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:25.894502 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:25.895826 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:25.972939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-09e64a3b-d159-4d2f-ad25-02839faf1914 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28627 microversion: 2.1 time: 0.114116 Sep 22 13:17:25.978008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 500/1063] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:25 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:26.017904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:26.019261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:26.025880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.026730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.027525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.028136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.169593 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:26.169815 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:26.170561 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:26.177076 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.177507 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c0478a68-6f92-49d1-b3d5-bdd13a5e2c52 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.167919 Sep 22 13:17:26.177640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.178099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 564/1064] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:26 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:26.178278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.178708 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.271000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lazy-loading 'services' on Instance uuid fbf14087-75d8-421b-9c66-9b1f74525492 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:17:26.338961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:26.339594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:26.346083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.346531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.347558 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.347999 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.478629 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:26.487378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:26.488889 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:26.490273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ecdf0344-a4ce-45d7-9b77-66a01d570c47 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.155789 Sep 22 13:17:26.490827 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 565/1065] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:26 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:26.498696 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d1c5f734-004f-417a-9419-cfdcf9d05eb3 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492/os-volume_attachments/83d16b38-fc04-4f6c-999f-b60cdb68c228" status: 202 len: 0 microversion: 2.1 time: 0.336174 Sep 22 13:17:26.499463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 501/1066] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:17:26 2021] DELETE /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492/os-volume_attachments/83d16b38-fc04-4f6c-999f-b60cdb68c228 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:17:26.985482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:26.986455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:26.992591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.993189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:26.994102 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:26.994695 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.065061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c6f696e4-5ffc-4364-9c22-4a2fa054f32b tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28627 microversion: 2.1 time: 0.083348 Sep 22 13:17:27.072236 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 566/1067] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:26 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28627 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:27.194947 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:27.200401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:27.207909 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.208709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.209709 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.210424 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.384983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:27.393844 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d5f13a8b-8cd9-48ed-9b31-835daec8a338 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.203142 Sep 22 13:17:27.404187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 502/1068] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:27 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:27.510107 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:27.511071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:27.518793 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.519654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.523345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.523345 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.645129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:27.645896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:27.652799 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.653499 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.654606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:27.655197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:27.683727 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:17:27.706910 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:27.716368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:27.717928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:27.719095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb8caf1d-65f8-486c-a0a4-66864b34e557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.213256 Sep 22 13:17:27.729906 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 567/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:27 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:28.078050 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-005abe97-891b-4caf-af0d-72d98f1abd78 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 204 len: 0 microversion: 2.1 time: 0.436893 Sep 22 13:17:28.081516 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 503/1070] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:17:27 2021] DELETE /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:17:28.081669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:28.081669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:28.088059 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:28.088692 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.129817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.129982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:28.130192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.130192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.130366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.130366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.130366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.130366 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.169046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3db23008-877c-4c6a-88c0-d7f9e5d492e8 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 28627 microversion: 2.1 time: 0.092080 Sep 22 13:17:28.170989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 568/1071] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:28 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 28627 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:28.238702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:28.247764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4d5618d5-efca-4cc7-9ee9-1414962354d1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1515 microversion: 2.1 time: 0.163894 Sep 22 13:17:28.249581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 504/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:28 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:28.410963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:28.411595 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:28.418734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.419175 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.419975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.420428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.554575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:28.563374 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1657dc9a-ba48-4807-b593-9969182522cd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.156524 Sep 22 13:17:28.564161 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 569/1073] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:28 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:28.738705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:28.757142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:28.757142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.757142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.757142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:28.757800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:28.897529 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:28.907074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:28.908611 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:28.909788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4b8c86fd-1cd8-4591-a34f-f19c1d94f52f tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.175897 Sep 22 13:17:28.910346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 505/1074] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:28 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:29.181945 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:29.183098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:29.189838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.190398 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.191323 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.191901 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.266049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:29.266625 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:29.273284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.273728 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.274487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.274922 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.275575 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-62b00011-3677-42ba-8a9e-be2e057425b6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 29628 microversion: 2.1 time: 0.097467 Sep 22 13:17:29.276951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 570/1075] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:29 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 29628 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:29.407569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:29.415473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7fc5e2e8-9f6a-432c-bda2-afea81c0bfc4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1515 microversion: 2.1 time: 0.153032 Sep 22 13:17:29.416081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 506/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:29 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:29.582053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:29.582751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:29.589548 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.591234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.591234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.591234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.729022 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:29.737125 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f8d731c7-8b9a-47cf-a42d-fed33eff4cff tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.159067 Sep 22 13:17:29.737709 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 571/1077] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:29 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:29.928408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:29.928917 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:29.935941 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.936412 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:29.937188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:29.937612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.063289 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:30.072185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:30.074333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:30.075705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-26910313-d3b7-4c5c-a95a-7d7f746b7a3e tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1741 microversion: 2.20 time: 0.151296 Sep 22 13:17:30.076402 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 507/1078] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:29 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:30.287934 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:30.288941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:30.295561 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.296002 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.296768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.297192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.370727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97bfdce9-fa44-48e1-8f57-363b301fa6d9 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 31102 microversion: 2.1 time: 0.085691 Sep 22 13:17:30.371457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 572/1079] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:30 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 31102 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:30.432595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:30.433194 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:30.439117 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.448589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.448589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.448589 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.626515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-901bf003-6b2c-4c7e-98dc-5840ef8840e1 req-7571c2d2-9c9b-40c0-b52d-3591812d2c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf14087-75d8-421b-9c66-9b1f74525492", "name": "network-vif-deleted", "tag": "c567df70-76a0-4af2-8693-d7e886674661"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:30.628024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:30.628024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:17:30.636340 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-901bf003-6b2c-4c7e-98dc-5840ef8840e1 req-7571c2d2-9c9b-40c0-b52d-3591812d2c2c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.636791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-901bf003-6b2c-4c7e-98dc-5840ef8840e1 req-7571c2d2-9c9b-40c0-b52d-3591812d2c2c service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.639612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:30.647391 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-57231a80-82ff-43c4-b458-a07559a765f4 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1515 microversion: 2.1 time: 0.218579 Sep 22 13:17:30.647979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 508/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:30 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:30.658460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-901bf003-6b2c-4c7e-98dc-5840ef8840e1 req-7571c2d2-9c9b-40c0-b52d-3591812d2c2c service nova] Creating event network-vif-deleted:c567df70-76a0-4af2-8693-d7e886674661 for instance fbf14087-75d8-421b-9c66-9b1f74525492 on hv-cinder-81000 Sep 22 13:17:30.664081 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-901bf003-6b2c-4c7e-98dc-5840ef8840e1 req-7571c2d2-9c9b-40c0-b52d-3591812d2c2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041474 Sep 22 13:17:30.664777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 573/1081] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:17:30.754307 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:30.754945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:30.762128 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.762620 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.763470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:30.764085 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:30.975328 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:30.982673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5da939ed-9769-4e3c-8a1b-72cf9f8ce9f6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.232297 Sep 22 13:17:30.983235 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 509/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:30 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:31.094565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:31.095304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:31.101449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.101890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.102643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.103072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.226892 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:31.235013 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:31.236540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:31.237727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8d832483-2a5a-4a01-ad32-8f9919b72160 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1723 microversion: 2.20 time: 0.147348 Sep 22 13:17:31.238275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 574/1083] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:31 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:31.382132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:31.383146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:31.390705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.391152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.392267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.392715 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.468275 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-19978f60-c37d-44fb-afd7-067a7be3190f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 32827 microversion: 2.1 time: 0.089686 Sep 22 13:17:31.468963 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 510/1084] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:31 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 32827 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:31.665180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:31.665722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:31.672538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.672987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.673751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.674186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.714727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:31.715233 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:31.715794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lazy-loading 'fault' on Instance uuid fbf14087-75d8-421b-9c66-9b1f74525492 {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:17:31.762249 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77151483b3db49db9576b812654d46ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2009da3841b14ba69e6be541cc0ec136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:31.773315 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f71f8079-a36c-40de-ad9f-487bc844bcf1 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 200 len: 1309 microversion: 2.1 time: 0.111469 Sep 22 13:17:31.777698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 575/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:31 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:31.999633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:32.000384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:32.007403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.007882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.008669 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.009098 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.144427 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:32.152119 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1991a67c-08ee-4e90-8a44-d1e42ac62914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.157432 Sep 22 13:17:32.152694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 511/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:31 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:32.256496 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:32.257019 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:32.263109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.263812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.264528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.264954 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.392875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:32.400922 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:32.403697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:32.405676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1a5bf5c6-40e5-4ac6-8002-a5a2fce14fd7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1723 microversion: 2.20 time: 0.152717 Sep 22 13:17:32.406633 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 576/1087] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:32 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:32.480088 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:32.481058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:32.487332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.487805 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.488574 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.489000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.561483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c04068c9-269c-43f2-aea9-aed1f3677426 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 33511 microversion: 2.1 time: 0.085565 Sep 22 13:17:32.562306 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 512/1088] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:32 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 33511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:32.801657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:32.802269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] [instance: fbf14087-75d8-421b-9c66-9b1f74525492] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:32.808325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.808773 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.809538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:32.809974 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:32.823614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] HTTP exception thrown: Instance fbf14087-75d8-421b-9c66-9b1f74525492 could not be found. Sep 22 13:17:32.824137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] Returning 404 to user: Instance fbf14087-75d8-421b-9c66-9b1f74525492 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:17:32.824989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5473c33d-9c5e-4a85-9be9-237b72cadbf8 tempest-VolumesSnapshotTestJSON-451897518 tempest-VolumesSnapshotTestJSON-451897518-project] 10.222.0.43 "GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492" status: 404 len: 111 microversion: 2.1 time: 0.028026 Sep 22 13:17:32.825568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 577/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:32 2021] GET /compute/v2.1/servers/fbf14087-75d8-421b-9c66-9b1f74525492 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:17:33.169429 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:33.170146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:33.176532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.176981 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.182141 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.182141 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.299956 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:33.307928 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8076cf8b-d575-46a8-b02a-b36acdcc7821 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.142666 Sep 22 13:17:33.308568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 513/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:33 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:33.428614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:33.429378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:33.437153 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.442154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.442154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.442154 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.566904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:33.576092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:33.577726 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:33.578155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:33.579235 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c2ed8db-4a6e-4305-86ba-82b21d7df007 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1726 microversion: 2.20 time: 0.154102 Sep 22 13:17:33.579369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:33.579795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 578/1091] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:33 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:33.590211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.590211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.590211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.590211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.596621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f48c3c02-e8d1-4c1a-b6bb-b028e09075d9"}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:33.597659 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:33.604426 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.604940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.605714 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.606139 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.661000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-66971cf6-7df1-4ce3-b116-ceb762d42934 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 34629 microversion: 2.1 time: 0.086321 Sep 22 13:17:33.661657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 514/1092] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:33 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 34629 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:33.690037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-993d025c-bdc2-48cd-8860-679bc1039bce req-41e13b88-b001-4af6-9487-ac935ba472c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125b6ac-217a-4c3b-a263-7459bb3268ae", "name": "network-vif-plugged", "status": "completed", "tag": "95ed0171-069d-4864-a2cc-88942442a595"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:33.691544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:33.691544 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:17:33.702531 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-993d025c-bdc2-48cd-8860-679bc1039bce req-41e13b88-b001-4af6-9487-ac935ba472c4 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:33.702977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-993d025c-bdc2-48cd-8860-679bc1039bce req-41e13b88-b001-4af6-9487-ac935ba472c4 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:33.716401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-993d025c-bdc2-48cd-8860-679bc1039bce req-41e13b88-b001-4af6-9487-ac935ba472c4 service nova] Creating event network-vif-plugged:95ed0171-069d-4864-a2cc-88942442a595 for instance 7125b6ac-217a-4c3b-a263-7459bb3268ae on hv-cinder-81000 Sep 22 13:17:33.721682 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-993d025c-bdc2-48cd-8860-679bc1039bce req-41e13b88-b001-4af6-9487-ac935ba472c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 Sep 22 13:17:33.722279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 515/1093] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:17:34.325578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:34.326367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:34.332348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:34.338256 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:34.338256 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:34.338256 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:34.463944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:34.471637 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-836ae758-f539-4a57-97ca-cabb89cfca35 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.150538 Sep 22 13:17:34.472210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 516/1094] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:34 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:34.673143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:34.674086 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:34.679877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:34.680324 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:34.681091 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:34.681573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:34.756563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0e07fa6a-b6a3-4816-866c-bb9bdf0632e6 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 35684 microversion: 2.1 time: 0.086986 Sep 22 13:17:34.757217 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 517/1095] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:34 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 35684 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:34.871806 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-44b73523-9cac-44f9-8c22-f0da40c3d438 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.278749 Sep 22 13:17:34.872468 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 579/1096] 10.222.0.43 () {62 vars in 1364 bytes} [Wed Sep 22 13:17:33 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments => generated 188 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 13:17:35.016148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:35.016752 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:35.023974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.024444 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.028832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.028832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.495957 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:35.496565 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:35.502441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.502880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.503673 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.504099 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.630131 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:35.637971 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f272db2d-a5bb-4ac7-ad31-1121f9c8a6ab tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1265 microversion: 2.1 time: 0.145756 Sep 22 13:17:35.638530 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 580/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:35 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:17:35.736245 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-0abbc429-75be-4a48-9a24-2383e78e726b req-0a89c26f-52bb-4260-9d04-dd8a8883b49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "name": "network-vif-unplugged", "status": "completed", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:35.738435 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:35.738435 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:17:35.749765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0abbc429-75be-4a48-9a24-2383e78e726b req-0a89c26f-52bb-4260-9d04-dd8a8883b49a service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.753807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-0abbc429-75be-4a48-9a24-2383e78e726b req-0a89c26f-52bb-4260-9d04-dd8a8883b49a service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.763570 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.compute.server_external_events [req-0abbc429-75be-4a48-9a24-2383e78e726b req-0a89c26f-52bb-4260-9d04-dd8a8883b49a service nova] Unable to find a host for instance 62793f2a-0117-416d-89c6-6c431f18e376. Dropping event network-vif-unplugged {{(pid=109168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 22 13:17:35.764682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-0abbc429-75be-4a48-9a24-2383e78e726b req-0a89c26f-52bb-4260-9d04-dd8a8883b49a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032358 Sep 22 13:17:35.765286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 581/1098] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:35 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 22 13:17:35.770653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:35.771924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:35.779950 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.780391 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:35.781185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:35.781613 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:36.779416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b5162bdf-ebc9-40a9-99f4-141f2576607a tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments/f48c3c02-e8d1-4c1a-b6bb-b028e09075d9" status: 202 len: 0 microversion: 2.20 time: 1.767682 Sep 22 13:17:36.780194 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 518/1099] 10.222.0.43 () {60 vars in 1457 bytes} [Wed Sep 22 13:17:35 2021] DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments/f48c3c02-e8d1-4c1a-b6bb-b028e09075d9 => generated 0 bytes in 1770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 13:17:36.784807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:36.785522 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:36.792151 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:36.792624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:36.793415 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:36.793852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:36.920222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:36.927759 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d98c29a8-ded3-4231-ac9b-6e59a09d9ba3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1449 microversion: 2.1 time: 0.146415 Sep 22 13:17:36.928351 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 519/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:36 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:36.933012 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:36.933571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:36.939500 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:36.939978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:36.940743 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:36.941172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:37.190340 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6b35d8d5-1105-4ddd-91f8-41df5f06c1bb tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action" status: 202 len: 0 microversion: 2.20 time: 0.259404 Sep 22 13:17:37.191342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 520/1101] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Sep 22 13:17:36 2021] POST /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:17:37.197499 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:37.198862 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:37.204700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:37.205151 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:37.205943 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:37.206377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:37.343258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:37.355563 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e702d789-50e5-4034-ab81-6f2712ff9d33 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1449 microversion: 2.1 time: 0.162559 Sep 22 13:17:37.356721 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 521/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:17:37 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:17:37.364119 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:37.364869 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:37.372493 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:37.377189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:37.377189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:37.377189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:37.545471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:37.554104 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:37.555541 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:37.556803 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c8ce61c0-da9f-4b65-8d00-eecaf6450fea tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1674 microversion: 2.20 time: 0.196498 Sep 22 13:17:37.557514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 522/1103] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:37 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:38.081404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2e83e076-ccda-4a8a-815d-3cbcd17744e7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 38158 microversion: 2.1 time: 2.314666 Sep 22 13:17:38.082807 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 582/1104] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:35 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 38158 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:38.590457 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:38.591559 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:38.598680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:38.599125 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:38.599958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:38.600399 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:38.813427 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:38.822206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:38.823745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:38.824960 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-09b1eef6-b7a0-4b9a-abe2-cf95fb8432d0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1674 microversion: 2.20 time: 0.242599 Sep 22 13:17:38.825538 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 523/1105] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:38 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:39.096040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:39.097068 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:39.104481 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:39.104930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:39.105719 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:39.106263 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:39.173998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d74ef246-2ea0-42ec-94e0-556eeb919482 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 38158 microversion: 2.1 time: 0.082360 Sep 22 13:17:39.174926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 583/1106] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:39 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 38158 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:39.854680 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:39.855397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:39.862663 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:39.865914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:39.865914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:39.866731 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:40.166896 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:40.178652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:40.182003 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:40.184374 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-33793a8a-6c34-42ba-b0a4-fe64be8e42ab tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.334756 Sep 22 13:17:40.185557 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 524/1107] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:39 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:40.188196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:40.189225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:40.197133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:40.197923 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:40.198952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:40.199394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:40.269421 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e50e50c3-965a-4518-ac0a-132789d7c743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 38158 microversion: 2.1 time: 0.085649 Sep 22 13:17:40.270270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 584/1108] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:40 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 38158 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:40.394706 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-5d5aaba7-225a-4ad4-8448-54b180e44c35 req-2bea8c9a-a5dd-4d39-96af-7d3a30a578b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7125b6ac-217a-4c3b-a263-7459bb3268ae", "tag": "95ed0171-069d-4864-a2cc-88942442a595"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:40.396876 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:40.396876 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:17:40.404553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5d5aaba7-225a-4ad4-8448-54b180e44c35 req-2bea8c9a-a5dd-4d39-96af-7d3a30a578b0 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:40.405051 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-5d5aaba7-225a-4ad4-8448-54b180e44c35 req-2bea8c9a-a5dd-4d39-96af-7d3a30a578b0 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:40.419099 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-5d5aaba7-225a-4ad4-8448-54b180e44c35 req-2bea8c9a-a5dd-4d39-96af-7d3a30a578b0 service nova] Creating event network-changed:95ed0171-069d-4864-a2cc-88942442a595 for instance 7125b6ac-217a-4c3b-a263-7459bb3268ae on hv-cinder-81000 Sep 22 13:17:40.424812 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-5d5aaba7-225a-4ad4-8448-54b180e44c35 req-2bea8c9a-a5dd-4d39-96af-7d3a30a578b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033639 Sep 22 13:17:40.425578 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 525/1109] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:17:41.208407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:41.209200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:41.226952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.227257 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.228569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.229112 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.285971 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:41.298259 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:41.302227 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.303080 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.305422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.306849 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.377738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-53d018ff-936d-41ee-897e-b4a34709e300 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action" status: 200 len: 38288 microversion: 2.1 time: 0.099031 Sep 22 13:17:41.384026 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 526/1110] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:17:41 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/action => generated 38288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 13:17:41.384379 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:41.389058 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:41.389797 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:41.392158 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:41.393703 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:41.395076 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3bcd900f-eb1d-471f-ad39-7b64da547557 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.191442 Sep 22 13:17:41.396260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 585/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:41 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:41.396740 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.397192 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.398962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:41.398962 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:41.422466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3183e5d5-56f0-44fd-89a9-f11dc077e5a5 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037570 Sep 22 13:17:41.422939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 527/1112] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:17:41 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:17:42.413493 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:42.414103 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:42.421329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:42.421783 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:42.422610 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:42.423039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:42.554146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:42.564162 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:42.565761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:42.566913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c584b4e9-2117-466c-b094-5e0a24229668 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.157147 Sep 22 13:17:42.567486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 586/1113] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:42 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:43.320055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1dd25c6-7d94-4a23-8038-a7c235068f84"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:43.321163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:43.328375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:43.328836 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:43.329606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:43.330061 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:43.586288 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:43.587654 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:43.594098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:43.594539 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:43.595314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:43.595790 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:43.747924 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:43.756795 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:43.757657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:43.759378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b26e6f9c-ef84-48d5-8474-db79bdc644e8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.176514 Sep 22 13:17:43.759970 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 587/1114] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:43 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:44.781228 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:44.782293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:44.794656 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:44.795961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:44.797785 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:44.798745 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:44.942553 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:44.954359 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:44.956718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:44.958697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eb37136d-4a34-4709-a6ef-bc506dde8f98 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.184778 Sep 22 13:17:44.958697 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 588/1115] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:44 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:45.981241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:45.982216 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:45.990585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:45.991093 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:45.992077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:45.992621 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:46.128581 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:46.137855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:46.138992 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:46.140224 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8db9db50-1b9e-422c-b9b6-8a2916c459fa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.166329 Sep 22 13:17:46.140838 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 589/1116] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:45 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:47.158757 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:47.159385 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:47.166214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:47.166837 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:47.168007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:47.168642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:47.304863 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:47.313660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:47.315133 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:47.316334 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6e065f50-9bac-447c-9184-c732083b849c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.161490 Sep 22 13:17:47.316897 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 590/1117] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:47 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:48.335522 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:48.336253 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:48.343616 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:48.344071 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:48.344972 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:48.345461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:48.501343 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:48.511343 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:48.512853 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:48.514030 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-72c58d17-804b-47b4-89b7-f38119e076bd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.183032 Sep 22 13:17:48.514990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 591/1118] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:48 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:49.533208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:49.534658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:49.541568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:49.542008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:49.542772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:49.543199 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:49.676482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:49.697119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:49.699375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:49.701090 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9de03abe-72a9-4887-b87d-5c6fc3fb2f66 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.171801 Sep 22 13:17:49.701738 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 592/1119] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:49 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:50.721700 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:50.723251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:50.730978 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:50.731618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:50.732669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:50.733568 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:50.860450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:50.868658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:50.870195 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:50.871383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7155b323-5d55-46f4-9a20-7d8632249dc7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.154554 Sep 22 13:17:50.872261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 593/1120] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:50 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:51.888652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:51.889346 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:51.895780 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:51.896290 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:51.897160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:51.897669 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:52.026461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:52.043459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:52.043459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:52.043459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-429f8314-1d66-4dd0-b386-04782230caa0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.157514 Sep 22 13:17:52.046040 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 594/1121] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:51 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:53.062456 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:53.063140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:53.069602 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:53.070092 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:53.071778 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:53.072448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:53.219759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:53.229007 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:53.231159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:53.233419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97e0d089-fd30-4f4d-9bf9-2c1ab5869e7c tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.174562 Sep 22 13:17:53.234453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 595/1122] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:53 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:54.254220 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:54.254935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:54.261649 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:54.262095 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:54.262880 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:54.263315 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:54.395211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:54.403241 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:54.404791 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:54.406026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-705f1ec8-be8b-4905-93c7-29ea7ec6c7f7 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.155505 Sep 22 13:17:54.406593 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 596/1123] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:54 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:17:54.874810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bca1121e-1cd3-4dd1-91f7-de3a8ee6b084 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.559137 Sep 22 13:17:54.875410 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 528/1124] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:17:43 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 194 bytes in 11561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:17:55.424851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:55.425512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:55.431333 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:55.431817 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:55.432618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:55.433251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:55.564614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:55.574655 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:55.576278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:55.577579 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4baa996e-46a2-44fb-8470-8e2777413897 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.156870 Sep 22 13:17:55.578450 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 597/1125] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:55 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:56.598102 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:56.598795 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:56.607152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:56.607641 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:56.608428 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:56.608860 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:56.746468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:56.755045 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:56.756472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:56.757694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8742fb0f-06ab-4bb0-a578-ba777008d1a8 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.164417 Sep 22 13:17:56.758877 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 529/1126] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:56 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:57.777070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:57.777682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:57.784529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:57.784979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:57.785839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:57.786310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:57.915061 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:57.923630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:57.925167 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:57.926356 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ef066cba-8004-4570-bb7f-293ce5f0c7f1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.153518 Sep 22 13:17:57.926935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 598/1127] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:57 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:17:58.280409 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-1a33a066-ccb8-48d7-a903-a2b39e10ef4c req-f3f927cf-d8e9-4ac9-9f1a-595ce6569648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "name": "network-vif-plugged", "status": "completed", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:17:58.282014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:17:58.282014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:17:58.289569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-1a33a066-ccb8-48d7-a903-a2b39e10ef4c req-f3f927cf-d8e9-4ac9-9f1a-595ce6569648 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:58.290497 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-1a33a066-ccb8-48d7-a903-a2b39e10ef4c req-f3f927cf-d8e9-4ac9-9f1a-595ce6569648 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:58.301810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-1a33a066-ccb8-48d7-a903-a2b39e10ef4c req-f3f927cf-d8e9-4ac9-9f1a-595ce6569648 service nova] Creating event network-vif-plugged:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:17:58.306997 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-1a33a066-ccb8-48d7-a903-a2b39e10ef4c req-f3f927cf-d8e9-4ac9-9f1a-595ce6569648 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Sep 22 13:17:58.308200 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 530/1128] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:17:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:17:58.946233 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:17:58.946820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:17:58.952933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:58.953384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:58.954170 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:17:58.954603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:17:59.086138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:59.104515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:59.106120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:17:59.107298 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0d3352c6-68e5-47fe-b8b5-cbc00dabcc77 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.165088 Sep 22 13:17:59.107893 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 599/1129] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:17:58 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:18:00.126367 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:00.127078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:00.133162 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:00.133679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:00.134450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:00.134880 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:00.263518 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:00.269918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:00.271472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:00.272871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-aae21a44-52bf-48c4-aec5-0dcef3b23efe tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.151065 Sep 22 13:18:00.273753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 531/1130] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:00 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:18:01.294988 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:01.295905 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:01.302110 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:01.302631 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:01.303537 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:01.304054 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:01.460216 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:01.469115 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:01.470592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:01.471769 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ecaffb9c-38b7-4535-84fe-575009891132 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1732 microversion: 2.20 time: 0.180663 Sep 22 13:18:01.472412 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 600/1131] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:01 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:18:02.489773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:02.490728 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:02.491967 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:02.492582 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:02.497958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.498403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.499160 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.499285 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.499609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.499722 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.500383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.500814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.530716 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2700664e-7618-46fa-acc4-00124aef0417 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Sep 22 13:18:02.531294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 532/1132] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:18:02 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:02.544115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:02.544606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:02.550884 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.551339 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.552182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:02.552612 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:02.586508 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1464b7cd-3ce8-4b72-b8f4-416f6471e28f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84" status: 200 len: 194 microversion: 2.1 time: 0.046880 Sep 22 13:18:02.592891 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 533/1133] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Sep 22 13:18:02 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:18:02.632821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:02.641787 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:02.649938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:02.649938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7cf7c70f-73e3-4573-86c8-76395888c926 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1719 microversion: 2.20 time: 0.156284 Sep 22 13:18:02.649938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 601/1134] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:02 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:18:04.212349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3c352dd-2322-496b-b597-9ee8291b960d"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:18:04.213591 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:04.220655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:04.221103 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:04.221938 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:04.222373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:05.045443 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-464ea583-c2b8-467d-9e1f-d044faa658de tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837422 Sep 22 13:18:05.046087 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 534/1135] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Sep 22 13:18:04 2021] POST /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:12.637667 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:12.638598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:12.645202 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:12.645653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:12.646497 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:12.646938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:12.682141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d762a2d0-3fc5-42ae-a6dc-ece9f8d93656 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049151 Sep 22 13:18:12.682740 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 602/1136] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:18:12 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:12.961146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:12.962050 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:12.969940 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:12.970389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:12.971186 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:12.971654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:13.007652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d1ffc3aa-6cb1-40aa-8ad3-229dc10ae743 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84" status: 200 len: 194 microversion: 2.1 time: 0.051107 Sep 22 13:18:13.008265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 535/1137] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Sep 22 13:18:12 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:13.024766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:13.025261 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:13.031459 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:13.032024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:13.032820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:13.033259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:13.127891 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lazy-loading 'services' on Instance uuid e53b0e58-00af-455d-992d-25020215286d {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:18:13.351949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-643b84a6-898f-474b-9353-956fd1c71013 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84" status: 202 len: 0 microversion: 2.1 time: 0.331280 Sep 22 13:18:13.352449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 603/1138] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:18:13 2021] DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/c1dd25c6-7d94-4a23-8038-a7c235068f84 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:18:15.549405 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:15.550207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:15.558096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:15.558536 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:15.559321 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:15.559773 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:15.596673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-344e887c-723d-41e1-b83e-906e7b976186 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/b3c352dd-2322-496b-b597-9ee8291b960d" status: 200 len: 194 microversion: 2.1 time: 0.051084 Sep 22 13:18:15.597280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 536/1139] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Sep 22 13:18:15 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/b3c352dd-2322-496b-b597-9ee8291b960d => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:15.611851 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:15.612475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:15.619550 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:15.620043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:15.620881 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:15.621321 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:15.715363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lazy-loading 'services' on Instance uuid e53b0e58-00af-455d-992d-25020215286d {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:18:16.002001 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-69d016e6-7532-4220-adef-50d52f4f3a88 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/b3c352dd-2322-496b-b597-9ee8291b960d" status: 202 len: 0 microversion: 2.1 time: 0.397390 Sep 22 13:18:16.003523 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 604/1140] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Sep 22 13:18:15 2021] DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments/b3c352dd-2322-496b-b597-9ee8291b960d => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:18:17.186008 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:17.187519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:17.193408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.193850 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.195225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.195756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.226705 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-782672bd-f01e-42cb-bef8-515d51add5fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044523 Sep 22 13:18:17.227566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 537/1141] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:18:17 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:18:17.341585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:17.342648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:17.349341 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.349786 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.350672 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.351870 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.385766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ee66abf5-675b-4754-bf79-1c531569b48f tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048314 Sep 22 13:18:17.386354 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 605/1142] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Sep 22 13:18:17 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 13:18:17.452679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:17.453210 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:17.459362 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.459846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.460725 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.461157 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.487694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:18:17.811369 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-83193754-c930-4f0e-b7ff-4b5e7a61cd08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 204 len: 0 microversion: 2.1 time: 0.362268 Sep 22 13:18:17.812060 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 538/1143] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:18:17 2021] DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:18:17.820529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:17.821229 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:17.827670 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.828118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.828899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:17.829335 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:17.965903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:17.973683 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0974e4bb-33bf-4889-915f-604fbf44f91a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1674 microversion: 2.1 time: 0.156987 Sep 22 13:18:17.974270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 606/1144] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:17 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:18:18.993353 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:18.993958 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:19.000014 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:19.000447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:19.001228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:19.001651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:19.125903 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:19.133581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e48db29d-c521-48bd-a8eb-14518ea7e2a7 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1674 microversion: 2.1 time: 0.145374 Sep 22 13:18:19.134146 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 539/1145] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:18 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:18:20.150760 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:20.151360 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:20.157255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:20.157715 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:20.158475 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:20.158899 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:20.320031 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:20.327411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7555ff18-e990-4f2a-bd25-938aec310b27 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1674 microversion: 2.1 time: 0.180313 Sep 22 13:18:20.327998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 607/1146] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:20 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:18:20.661178 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-de978225-50e6-4dec-80ba-647a42d74c40 req-8078b9c1-cc77-4f5b-98de-d3911092615b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53b0e58-00af-455d-992d-25020215286d", "name": "network-vif-deleted", "tag": "6a3f99ba-d71c-4230-ae3c-9417e9cad085"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:18:20.662807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:18:20.662807 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:18:20.671346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-de978225-50e6-4dec-80ba-647a42d74c40 req-8078b9c1-cc77-4f5b-98de-d3911092615b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:20.671756 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-de978225-50e6-4dec-80ba-647a42d74c40 req-8078b9c1-cc77-4f5b-98de-d3911092615b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:20.682865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-de978225-50e6-4dec-80ba-647a42d74c40 req-8078b9c1-cc77-4f5b-98de-d3911092615b service nova] Creating event network-vif-deleted:6a3f99ba-d71c-4230-ae3c-9417e9cad085 for instance e53b0e58-00af-455d-992d-25020215286d on hv-cinder-81000 Sep 22 13:18:20.687970 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-de978225-50e6-4dec-80ba-647a42d74c40 req-8078b9c1-cc77-4f5b-98de-d3911092615b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030744 Sep 22 13:18:20.688685 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 540/1147] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:21.344671 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:21.345260 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:21.351595 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:21.357915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:21.357915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:21.357915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:21.385312 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:21.385768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:21.386213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lazy-loading 'fault' on Instance uuid e53b0e58-00af-455d-992d-25020215286d {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:18:21.427351 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1874f2072dc6484287af0c34360a1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eaec60ee64de8bef900efc8811d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:21.435716 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-84a99e20-e376-4f95-8543-9c107549fe04 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 200 len: 1328 microversion: 2.1 time: 0.095487 Sep 22 13:18:21.436292 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 608/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:21 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:18:22.454077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:22.454764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:22.461576 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:22.462015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:22.462771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:22.463200 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:22.476714 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. Sep 22 13:18:22.477301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:22.478147 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3a21c881-012f-4b67-9ef8-8db4fbb52a08 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 404 len: 111 microversion: 2.1 time: 0.028248 Sep 22 13:18:22.478670 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 541/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:22 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:22.486898 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-32256653-ba36-44ef-98d2-7df9d4bd13fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '.version_select at 0x7fa7181759d0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:22.567072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-32256653-ba36-44ef-98d2-7df9d4bd13fc tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890736008" status: 202 len: 0 microversion: 2.1 time: 0.083584 Sep 22 13:18:22.567599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 609/1150] 10.222.0.43 () {58 vars in 1221 bytes} [Wed Sep 22 13:18:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890736008 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:18:26.077770 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:26.078276 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:26.084408 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:26.084852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:26.085667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:26.086689 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:26.100560 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. Sep 22 13:18:26.101143 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:26.102127 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-23ed9996-cd05-4abe-a5bc-0e6ffa5bfd1a tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 404 len: 111 microversion: 2.1 time: 0.028258 Sep 22 13:18:26.102651 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 542/1151] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:18:26 2021] DELETE /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:26.110601 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:26.111214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: e53b0e58-00af-455d-992d-25020215286d] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:26.117747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:26.125325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:26.125325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:26.125325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:26.134718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. Sep 22 13:18:26.135304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance e53b0e58-00af-455d-992d-25020215286d could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:26.136169 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-04cd0974-b0da-41df-ad0f-331a491c5b98 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d" status: 404 len: 111 microversion: 2.1 time: 0.029487 Sep 22 13:18:26.136698 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 610/1152] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:26 2021] GET /compute/v2.1/servers/e53b0e58-00af-455d-992d-25020215286d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:27.450813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:27.451384 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:27.457953 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:27.458400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:27.459172 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:27.459675 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:27.474566 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. Sep 22 13:18:27.475207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:27.476081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bfcf74e2-9ed3-4297-b7fe-d29d471bed36 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 404 len: 111 microversion: 2.1 time: 0.029100 Sep 22 13:18:27.476746 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 543/1153] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:18:27 2021] DELETE /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:27.486941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:27.487589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] [instance: 34469eaa-a287-41e5-a5cd-ad889e389ada] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:27.493630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:27.497451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:27.497451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:27.497451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:27.510638 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] HTTP exception thrown: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. Sep 22 13:18:27.511225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] Returning 404 to user: Instance 34469eaa-a287-41e5-a5cd-ad889e389ada could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:27.512114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-87ec3638-7687-45f7-b84b-ebaeb350a152 tempest-AttachVolumeTestJSON-605221999 tempest-AttachVolumeTestJSON-605221999-project] 10.222.0.43 "GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada" status: 404 len: 111 microversion: 2.1 time: 0.029307 Sep 22 13:18:27.512645 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 611/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:27 2021] GET /compute/v2.1/servers/34469eaa-a287-41e5-a5cd-ad889e389ada => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:35.644762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:35.645723 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:35.652822 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:35.653267 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:35.654048 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:35.654487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:35.694145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8b62b902-202b-4109-927b-85d3f602b836 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052740 Sep 22 13:18:35.701155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 544/1155] 10.222.0.43 () {60 vars in 1343 bytes} [Wed Sep 22 13:18:35 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:18:35.768182 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:35.768718 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:35.775552 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:35.776097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:35.776884 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:35.777389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:35.807687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:18:36.084455 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6a3cf6ab-fd3b-4493-a870-89530a0b71af tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 204 len: 0 microversion: 2.20 time: 0.319576 Sep 22 13:18:36.084966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 612/1156] 10.222.0.43 () {60 vars in 1280 bytes} [Wed Sep 22 13:18:35 2021] DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 22 13:18:36.093628 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:36.094225 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:36.101313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:36.101907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:36.102802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:36.103476 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:36.248493 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:36.257228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:36.259318 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:36.260655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b58ce678-bb52-49cc-97a1-8f441be1e821 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.171149 Sep 22 13:18:36.261201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 545/1157] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:36 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 13:18:37.288960 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:37.289657 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:37.295597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:37.296046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:37.296820 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:37.297251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:37.423747 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:37.431750 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:37.433231 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:37.434413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5be767bd-2f01-48c8-84b1-72a0f4942ffa tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1725 microversion: 2.20 time: 0.150121 Sep 22 13:18:37.434966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 613/1158] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:37 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:18:38.410377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-2b38472f-6018-4469-a4ff-acb75e2ba777 req-a5bb2d79-91a6-4759-8140-c88022e1eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62793f2a-0117-416d-89c6-6c431f18e376", "name": "network-vif-deleted", "tag": "41fae7da-fc4d-4e0a-8de7-c46984894344"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:18:38.412199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:18:38.412199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:18:38.419781 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-2b38472f-6018-4469-a4ff-acb75e2ba777 req-a5bb2d79-91a6-4759-8140-c88022e1eb99 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:38.420226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-2b38472f-6018-4469-a4ff-acb75e2ba777 req-a5bb2d79-91a6-4759-8140-c88022e1eb99 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:38.432315 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-2b38472f-6018-4469-a4ff-acb75e2ba777 req-a5bb2d79-91a6-4759-8140-c88022e1eb99 service nova] Creating event network-vif-deleted:41fae7da-fc4d-4e0a-8de7-c46984894344 for instance 62793f2a-0117-416d-89c6-6c431f18e376 on hv-cinder-81000 Sep 22 13:18:38.437569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-2b38472f-6018-4469-a4ff-acb75e2ba777 req-a5bb2d79-91a6-4759-8140-c88022e1eb99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Sep 22 13:18:38.438370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 546/1159] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:18:38.460147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:38.460776 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:38.470249 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:38.475894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:38.475894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:38.475894 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:38.544298 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:38.557722 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:38.559322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eff64a9da614bd2b032bdc469a62b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b927b18a264e798ad9389f4c099037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:18:38.561025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8eb4640d-2091-4bc0-b696-5d2158d37008 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 200 len: 1657 microversion: 2.20 time: 0.110852 Sep 22 13:18:38.561939 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 614/1160] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:38 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 1657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 13:18:39.581255 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:39.582597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:39.590032 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:39.594131 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:39.594131 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:39.594131 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:39.606737 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. Sep 22 13:18:39.607403 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:39.608323 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-8b6a5c9e-bda9-4dad-b12d-7191c06f09e1 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 404 len: 111 microversion: 2.20 time: 0.031296 Sep 22 13:18:39.608983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 547/1161] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Sep 22 13:18:39 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 13:18:39.624470 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c019c86f-0155-4601-bdbc-4e9071f8122d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '.version_select at 0x7fa7180fd280>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:39.720028 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c019c86f-0155-4601-bdbc-4e9071f8122d tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971069780" status: 204 len: 0 microversion: 2.20 time: 0.099196 Sep 22 13:18:39.720772 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 615/1162] 10.222.0.43 () {60 vars in 1262 bytes} [Wed Sep 22 13:18:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971069780 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 22 13:18:41.347298 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:18:41.351036 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: Wed Sep 22 13:18:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:18:41.773343 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:41.773865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:41.780129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:41.780692 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:41.781497 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:41.781939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:41.795530 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. Sep 22 13:18:41.796118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:41.796948 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-adfa887a-6bc7-4078-914c-20ed7097ce67 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 404 len: 111 microversion: 2.1 time: 0.028113 Sep 22 13:18:41.797507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 548/1163] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:18:41 2021] DELETE /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:41.806000 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:41.806647 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: 62793f2a-0117-416d-89c6-6c431f18e376] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:41.812830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:41.813313 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:41.814142 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:41.814599 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:41.830465 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. Sep 22 13:18:41.831072 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance 62793f2a-0117-416d-89c6-6c431f18e376 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:41.831946 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2433380e-03a7-4caa-b0b5-55527b3df1c0 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376" status: 404 len: 111 microversion: 2.1 time: 0.030145 Sep 22 13:18:41.833098 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 616/1164] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:41 2021] GET /compute/v2.1/servers/62793f2a-0117-416d-89c6-6c431f18e376 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:43.174370 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:43.174937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:43.180832 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:43.181277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:43.182094 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:43.182519 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:43.196464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. Sep 22 13:18:43.197050 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:43.197870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c6e58838-c588-473f-b7e6-df4e345bd9dd tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 404 len: 111 microversion: 2.1 time: 0.027290 Sep 22 13:18:43.198412 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 549/1165] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:18:43 2021] DELETE /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:43.206847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:43.207473 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] [instance: a4d69add-5d3b-4453-bf51-5a27d905e4e7] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:18:43.214436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:43.215156 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:43.215794 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:18:43.216227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:18:43.229619 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] HTTP exception thrown: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. Sep 22 13:18:43.230193 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] Returning 404 to user: Instance a4d69add-5d3b-4453-bf51-5a27d905e4e7 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:43.231020 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3bab2a7d-8fb4-4e13-8ff6-2d099f8d1f06 tempest-AttachVolumeShelveTestJSON-848204664 tempest-AttachVolumeShelveTestJSON-848204664-project] 10.222.0.43 "GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7" status: 404 len: 111 microversion: 2.1 time: 0.028355 Sep 22 13:18:43.231590 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 617/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:18:43 2021] GET /compute/v2.1/servers/a4d69add-5d3b-4453-bf51-5a27d905e4e7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:18:49.188598 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1e45fb0d-090f-4739-8b16-dbd919c21026 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Action: 'create', calling method: .version_select at 0x7fa7180a84c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-564344108", "metadata": {"Type": "work"}}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:18:49.967546 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1e45fb0d-090f-4739-8b16-dbd919c21026 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.890250 Sep 22 13:18:49.968161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 550/1167] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Sep 22 13:18:49 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 892 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 13:18:49.979684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-316c744b-30ec-438a-9137-6477e5ec0469 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa7181063a0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:50.034732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-316c744b-30ec-438a-9137-6477e5ec0469 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 200 len: 352 microversion: 2.1 time: 0.058486 Sep 22 13:18:50.034732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 618/1168] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:18:49 2021] GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:51.051342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-52621f35-e2ef-4a50-ba12-f81dde3ae28e tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa712ff2e50>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:51.104562 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-52621f35-e2ef-4a50-ba12-f81dde3ae28e tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 200 len: 353 microversion: 2.1 time: 0.056976 Sep 22 13:18:51.105188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 551/1169] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:18:51 2021] GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:51.116773 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7f618d4e-9747-444a-af2a-f7047d5eede6 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa718175ca0>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:51.178862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7f618d4e-9747-444a-af2a-f7047d5eede6 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 200 len: 353 microversion: 2.1 time: 0.065409 Sep 22 13:18:51.179624 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 619/1170] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:18:51 2021] GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:18:51.196329 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ed34324d-0e1c-4046-aad1-2a64d7e0382d tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa71816dee0>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:51.382648 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ed34324d-0e1c-4046-aad1-2a64d7e0382d tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 202 len: 0 microversion: 2.1 time: 0.190490 Sep 22 13:18:51.383303 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 552/1171] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Sep 22 13:18:51 2021] DELETE /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:18:51.394776 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-30669043-47a0-47f6-8446-5afec7432de8 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa71812fa60>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:51.453774 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-30669043-47a0-47f6-8446-5afec7432de8 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 200 len: 352 microversion: 2.1 time: 0.064406 Sep 22 13:18:51.454376 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 620/1172] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:18:51 2021] GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:18:52.465980 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-11e00683-e17c-47f3-9969-78a74a38a127 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Calling method '.version_select at 0x7fa712ff2b80>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:18:52.493765 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-11e00683-e17c-47f3-9969-78a74a38a127 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] HTTP exception thrown: Volume ffb3f337-67a5-49b4-b1da-276640c0171f could not be found. Sep 22 13:18:52.494360 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-11e00683-e17c-47f3-9969-78a74a38a127 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] Returning 404 to user: Volume ffb3f337-67a5-49b4-b1da-276640c0171f could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:18:52.495265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-11e00683-e17c-47f3-9969-78a74a38a127 tempest-VolumesGetTestJSON-1982100045 tempest-VolumesGetTestJSON-1982100045-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f" status: 404 len: 109 microversion: 2.1 time: 0.033034 Sep 22 13:18:52.495839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 553/1173] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Sep 22 13:18:52 2021] GET /compute/v2.1/os-volumes/ffb3f337-67a5-49b4-b1da-276640c0171f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:19:38.252159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:38.255126 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:38.259765 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:38.260244 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:38.261913 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:38.262206 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:38.294938 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:19:38.822648 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-df871634-e384-4b94-a70e-8e0c51aad810 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 204 len: 0 microversion: 2.1 time: 0.573873 Sep 22 13:19:38.832471 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 621/1174] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:19:38 2021] DELETE /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:19:38.832889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:38.833512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:38.841345 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:38.842057 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:38.842993 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:38.843910 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:38.998101 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:39.007624 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-76cb5a16-2f93-4d2a-b51d-f3d783164b3a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1573 microversion: 2.1 time: 0.179113 Sep 22 13:19:39.007952 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 554/1175] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:38 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:40.026185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:40.027043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:40.033144 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:40.033597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:40.034378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:40.034811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:40.169428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:40.177759 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3e782049-52ba-4a8b-9deb-b278ea51af06 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1573 microversion: 2.1 time: 0.155736 Sep 22 13:19:40.178417 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 622/1176] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:40 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:41.196171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:41.197067 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:41.203642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:41.204002 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:41.204791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:41.205220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:41.279671 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:41.301193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6513c188-5438-453d-950a-b51b10fc64bf tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1505 microversion: 2.1 time: 0.108786 Sep 22 13:19:41.302018 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 555/1177] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:41 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1505 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:41.331890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-7642fb6a-c712-4df8-b05f-1344241361ff req-116320fb-ac3e-4b3a-94e7-755c4f6fdd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125b6ac-217a-4c3b-a263-7459bb3268ae", "name": "network-vif-deleted", "tag": "95ed0171-069d-4864-a2cc-88942442a595"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:19:41.334217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:19:41.334217 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:19:41.342368 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-7642fb6a-c712-4df8-b05f-1344241361ff req-116320fb-ac3e-4b3a-94e7-755c4f6fdd94 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:41.343163 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-7642fb6a-c712-4df8-b05f-1344241361ff req-116320fb-ac3e-4b3a-94e7-755c4f6fdd94 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:41.371653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-7642fb6a-c712-4df8-b05f-1344241361ff req-116320fb-ac3e-4b3a-94e7-755c4f6fdd94 service nova] Creating event network-vif-deleted:95ed0171-069d-4864-a2cc-88942442a595 for instance 7125b6ac-217a-4c3b-a263-7459bb3268ae on hv-cinder-81000 Sep 22 13:19:41.376824 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-7642fb6a-c712-4df8-b05f-1344241361ff req-116320fb-ac3e-4b3a-94e7-755c4f6fdd94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047994 Sep 22 13:19:41.377443 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 623/1178] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:19:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:19:42.331212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:42.332553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:42.340525 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:42.340972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:42.341761 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:42.342220 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:42.385839 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:42.387182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:42.387182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lazy-loading 'fault' on Instance uuid 7125b6ac-217a-4c3b-a263-7459bb3268ae {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:19:42.435377 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:42.443901 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-0e3cbe24-69b1-4cbb-a2d3-0436e483ce81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1229 microversion: 2.1 time: 0.127359 Sep 22 13:19:42.444654 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 556/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:42 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:43.462146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:43.462751 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:43.469888 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:43.470419 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:43.471185 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:43.471652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:43.505146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:43.505612 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:43.506035 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lazy-loading 'fault' on Instance uuid 7125b6ac-217a-4c3b-a263-7459bb3268ae {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:19:43.548032 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:43.555461 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1de876e5-d4ad-4d15-a99e-1ca6d1f2a736 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1229 microversion: 2.1 time: 0.097377 Sep 22 13:19:43.556033 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 624/1180] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:43 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:44.572183 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:44.572855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:44.579065 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:44.579545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:44.580342 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:44.580776 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:44.614932 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:44.615459 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:44.615974 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lazy-loading 'fault' on Instance uuid 7125b6ac-217a-4c3b-a263-7459bb3268ae {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:19:44.658882 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:44.667584 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-76303754-a07c-4f4c-9751-dd81ffc6e914 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1229 microversion: 2.1 time: 0.098362 Sep 22 13:19:44.668163 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 557/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:44 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:45.684479 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:45.685105 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:45.692738 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:45.694322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:45.697047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:45.697047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:45.735839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:45.736292 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:45.736744 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.objects.instance [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lazy-loading 'fault' on Instance uuid 7125b6ac-217a-4c3b-a263-7459bb3268ae {{(pid=109168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:19:45.778973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:45.786273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d9cb7f8b-e978-425d-9055-eeaf7282e6ac tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 200 len: 1229 microversion: 2.1 time: 0.106300 Sep 22 13:19:45.786845 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 625/1182] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:45 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:46.803168 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:46.804286 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:46.811055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:46.811604 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:46.812404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:46.812845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:46.828813 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] HTTP exception thrown: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. Sep 22 13:19:46.829428 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Returning 404 to user: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:19:46.830255 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c2e82357-40e4-4831-b79d-9b35c4a71ce6 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 404 len: 111 microversion: 2.1 time: 0.031987 Sep 22 13:19:46.830829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 558/1183] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:46 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:19:46.936904 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-574328932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-289619331", "security_groups": [{"name": "tempest-secgroup-smoke-1876939705"}], "block_device_mapping_v2": [{"uuid": "e3644a2b-dedc-4f4d-b0fb-d065a141ba2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b2b60ff-ffa7-4f74-a063-d8f4477f3f78"}]}} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:19:47.051230 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.network.neutron [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] validate_networks() for [('3b2b60ff-ffa7-4f74-a063-d8f4477f3f78', None, None, None, None, None)] {{(pid=109168) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:19:47.524850 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:19:47.525271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image limits 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:19:47.525777 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:19:47.526298 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image pref 0:0:0 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:19:47.526650 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.virt.hardware [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:19:47.535710 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:47.536274 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:47.537225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:47.537734 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:47.556361 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:19:47.561278 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.quota [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for user bc4e105d110b4129b0765f02a4dbde7f and project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:19:47.626198 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Going to run 1 instances... {{(pid=109168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:19:47.628437 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3644a2b-dedc-4f4d-b0fb-d065a141ba2d',volume_size=None,volume_type=None)] {{(pid=109168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:19:48.082088 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c2ec6b5c-3638-4045-ab66-79903bc3414e tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.149057 Sep 22 13:19:48.083123 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 626/1184] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:19:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:19:48.093852 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e40abda7-19ff-4436-b100-9f953f7e1319 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:48.094416 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e40abda7-19ff-4436-b100-9f953f7e1319 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:48.147294 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e40abda7-19ff-4436-b100-9f953f7e1319 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:48.156064 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e40abda7-19ff-4436-b100-9f953f7e1319 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1093 microversion: 2.1 time: 0.065958 Sep 22 13:19:48.165506 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 559/1185] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:48 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:49.173587 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:49.174395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:49.180940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:49.181320 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:49.182729 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:49.183210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:49.245632 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:49.253728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f5adc26c-d531-4637-a776-a56f364cf227 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1143 microversion: 2.1 time: 0.084114 Sep 22 13:19:49.254432 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 627/1186] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:49 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:50.270011 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:50.270745 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:50.278193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:50.278777 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:50.279630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:50.280156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:50.342114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:50.349450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-65af05a1-6046-47a5-9629-10ff1f137b92 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1199 microversion: 2.1 time: 0.083163 Sep 22 13:19:50.350016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 560/1187] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:50 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:19:51.374312 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:51.375687 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:51.388083 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:51.388990 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:51.390196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:51.392145 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:51.556911 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:51.564920 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-320495e7-60f3-42a3-a5e6-a2d9ff3bef81 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1277 microversion: 2.1 time: 0.201090 Sep 22 13:19:51.565508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 628/1188] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:51 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:52.582814 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:52.583579 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:52.589874 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:52.590572 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:52.591477 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:52.592023 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:52.737972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:52.746199 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-09b3ad63-e0f6-4bc8-9da0-aaf0647484e3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1277 microversion: 2.1 time: 0.167635 Sep 22 13:19:52.746781 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 561/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:52 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:53.768142 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:53.770707 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:53.785134 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:53.785993 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:53.787510 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:53.788302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:53.962457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:53.975531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0c0d330e-575c-4606-8050-1fbeb0f4e661 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1277 microversion: 2.1 time: 0.213700 Sep 22 13:19:53.979933 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 629/1190] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:53 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:55.003244 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:55.005904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:55.018804 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:55.019818 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:55.020794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:55.021606 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:55.175326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-f8daebba-f6aa-4398-95bf-c6248850a37f req-bd2b3daf-12af-4848-a199-8d7da1c43ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a6fb66-08b8-4248-adb0-62b4e4c9ce54", "tag": "3cd57090-ec8a-4ed8-9989-2aeebda1778d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:19:55.178816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:19:55.178816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:19:55.190869 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f8daebba-f6aa-4398-95bf-c6248850a37f req-bd2b3daf-12af-4848-a199-8d7da1c43ca2 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:55.191589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-f8daebba-f6aa-4398-95bf-c6248850a37f req-bd2b3daf-12af-4848-a199-8d7da1c43ca2 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:55.204084 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-f8daebba-f6aa-4398-95bf-c6248850a37f req-bd2b3daf-12af-4848-a199-8d7da1c43ca2 service nova] Creating event network-changed:3cd57090-ec8a-4ed8-9989-2aeebda1778d for instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 on hv-cinder-81000 Sep 22 13:19:55.209618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-f8daebba-f6aa-4398-95bf-c6248850a37f req-bd2b3daf-12af-4848-a199-8d7da1c43ca2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 Sep 22 13:19:55.210303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 630/1191] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:19:55.735166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:55.749232 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-df17f222-4fd9-489b-93e9-e77f8fbbe63d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.751530 Sep 22 13:19:55.754732 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 562/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:54 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:56.782259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:56.783761 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:56.795618 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:56.796828 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:56.799405 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:56.800322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:57.006840 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:57.018528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e49667cd-b655-41ae-ba34-77c51c07ed4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.247744 Sep 22 13:19:57.019503 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 631/1193] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:56 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:19:58.035871 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:58.036788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:58.044616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:58.045749 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:58.046913 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:58.047997 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:58.312798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:58.325277 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-4a379ce5-ece4-4999-b7ae-dfb8520b611f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.293149 Sep 22 13:19:58.326449 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 563/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:58 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:19:59.349758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:19:59.351109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:19:59.361872 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:59.362408 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:59.363223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:19:59.363684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:19:59.516383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:19:59.524594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8e45dc1-015f-4451-9eae-02414399b74d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.182533 Sep 22 13:19:59.526005 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 632/1195] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:19:59 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:00.546978 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:00.549473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:00.562224 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:00.563473 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:00.565221 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:00.566299 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:00.804780 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:00.825898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a42efe01-d617-44a0-b60b-2ba4a732de05 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.286976 Sep 22 13:20:00.827686 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 564/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:00 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:01.845811 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:01.848559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:01.857148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:01.857679 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:01.858996 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:01.859549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:02.046101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:02.055404 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d9904977-b127-44f0-bbbb-edad28a995f5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.214547 Sep 22 13:20:02.058352 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 633/1197] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:01 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:20:03.082326 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:03.087633 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:03.090296 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:03.090977 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:03.091999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:03.092432 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:03.338983 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:03.347494 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3c895939-a2e0-4c09-9988-7fd636a0cfe4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.275019 Sep 22 13:20:03.348464 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 565/1198] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:03 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:04.375053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:04.376451 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:04.387498 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:04.388281 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:04.389442 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:04.389857 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:04.563406 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:04.581885 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-9569b3ff-c915-4893-900f-a4f363df0c39 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.209627 Sep 22 13:20:04.582576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 634/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:04 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:05.579762 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-b0a35c68-a638-4d9b-82d8-b04b8c57a6f5 req-fff0c1b8-6921-4a6e-b411-34468fca6cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a6fb66-08b8-4248-adb0-62b4e4c9ce54", "name": "network-vif-plugged", "status": "completed", "tag": "3cd57090-ec8a-4ed8-9989-2aeebda1778d"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:05.581435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:20:05.581435 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:20:05.589640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-b0a35c68-a638-4d9b-82d8-b04b8c57a6f5 req-fff0c1b8-6921-4a6e-b411-34468fca6cfa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:05.590107 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-b0a35c68-a638-4d9b-82d8-b04b8c57a6f5 req-fff0c1b8-6921-4a6e-b411-34468fca6cfa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:05.602665 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-b0a35c68-a638-4d9b-82d8-b04b8c57a6f5 req-fff0c1b8-6921-4a6e-b411-34468fca6cfa service nova] Creating event network-vif-plugged:3cd57090-ec8a-4ed8-9989-2aeebda1778d for instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 on hv-cinder-81000 Sep 22 13:20:05.608096 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:05.609015 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-b0a35c68-a638-4d9b-82d8-b04b8c57a6f5 req-fff0c1b8-6921-4a6e-b411-34468fca6cfa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Sep 22 13:20:05.609147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:05.610252 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 566/1200] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:20:05.615935 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:05.617384 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:05.619138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:05.619937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:05.833486 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:05.845949 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b39c0f1a-fb4c-4716-8a93-551e121dc729 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.242651 Sep 22 13:20:05.846859 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 635/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:05 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:20:06.874987 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:06.876467 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:06.888201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:06.889211 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:06.890802 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:06.891828 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:07.043230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Action: 'create', calling method: .version_select at 0x7fa718280b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1820163476"}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:07.075984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:20:07.081914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for user 87327f71209d4ebab3fb465c88b149c0 and project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:20:07.084101 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:07.093516 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d6fbb0cf-512a-4388-abfc-8e6b666886d4 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1265 microversion: 2.1 time: 0.226081 Sep 22 13:20:07.095229 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 636/1202] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:06 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:20:07.441301 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:20:07.447357 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for user 87327f71209d4ebab3fb465c88b149c0 and project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'key_pairs'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:20:07.463100 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bf3e4cde-e3a6-447a-aa72-dc51486368bc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.733694 Sep 22 13:20:07.463763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 567/1203] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Sep 22 13:20:06 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:08.124227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:08.126107 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:08.134555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:08.135078 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:08.137373 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:08.139532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:08.331882 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:08.338512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4ed200d8-1b70-4622-b1f9-3d1a5c0b4efa tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1450 microversion: 2.1 time: 0.217844 Sep 22 13:20:08.339386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 637/1204] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:08 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1450 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:08.356097 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:08.356830 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:08.363853 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:08.366309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:08.366309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:08.366309 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:08.632984 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:08.644288 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dad53120-992a-4670-9be3-b73068788c88 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1450 microversion: 2.1 time: 0.292538 Sep 22 13:20:08.644898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 568/1205] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:08 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1450 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:11.728540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-24b4c96e-8b9b-4576-bcbc-e3c497384a23 req-fa9f73a4-c5e3-4742-a65f-10d89e4ee37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a6fb66-08b8-4248-adb0-62b4e4c9ce54", "tag": "3cd57090-ec8a-4ed8-9989-2aeebda1778d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:11.730868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:20:11.730868 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:20:11.738684 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-24b4c96e-8b9b-4576-bcbc-e3c497384a23 req-fa9f73a4-c5e3-4742-a65f-10d89e4ee37e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:11.739124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-24b4c96e-8b9b-4576-bcbc-e3c497384a23 req-fa9f73a4-c5e3-4742-a65f-10d89e4ee37e service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:11.751775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-24b4c96e-8b9b-4576-bcbc-e3c497384a23 req-fa9f73a4-c5e3-4742-a65f-10d89e4ee37e service nova] Creating event network-changed:3cd57090-ec8a-4ed8-9989-2aeebda1778d for instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 on hv-cinder-81000 Sep 22 13:20:11.757771 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-24b4c96e-8b9b-4576-bcbc-e3c497384a23 req-fa9f73a4-c5e3-4742-a65f-10d89e4ee37e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040888 Sep 22 13:20:11.759164 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 638/1206] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:20:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:20:31.684461 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1315181825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1820163476", "security_groups": [{"name": "tempest-secgroup-smoke-1905113533"}], "networks": [{"uuid": "b272f558-e224-4fd2-b8d1-fa2ca461b31f"}], "block_device_mapping_v2": [{"uuid": "d31b93ef-d2bd-4587-b7bd-4d4c4e01d9b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:31.789800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] validate_networks() for [('b272f558-e224-4fd2-b8d1-fa2ca461b31f', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:20:32.162573 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:20:32.162982 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:20:32.163470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:20:32.163867 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:20:32.164265 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:20:32.172825 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:32.173257 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:32.174046 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:32.174469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:32.192632 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:20:32.198027 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Getting quotas for user 87327f71209d4ebab3fb465c88b149c0 and project 6b1e0e70b73e4fb1b5208231b5468fcf. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:20:32.264921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:20:32.267248 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d31b93ef-d2bd-4587-b7bd-4d4c4e01d9b9',volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:20:32.844142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-717ab18f-0417-4ce6-aeb9-a89fed983f8b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.163309 Sep 22 13:20:32.844829 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 569/1207] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:20:31 2021] POST /compute/v2.1/servers => generated 406 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:20:32.856303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-adf500b6-9345-4be6-8dc0-9172b913e5cb tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:32.857453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-adf500b6-9345-4be6-8dc0-9172b913e5cb tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:32.916017 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-adf500b6-9345-4be6-8dc0-9172b913e5cb tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:32.920598 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-adf500b6-9345-4be6-8dc0-9172b913e5cb tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1089 microversion: 2.1 time: 0.068281 Sep 22 13:20:32.921251 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 639/1208] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:32 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:33.937652 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ea59c001-f023-441d-bd15-904daa9fb77e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:33.938206 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ea59c001-f023-441d-bd15-904daa9fb77e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:33.988707 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ea59c001-f023-441d-bd15-904daa9fb77e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:33.996467 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ea59c001-f023-441d-bd15-904daa9fb77e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1089 microversion: 2.1 time: 0.062615 Sep 22 13:20:33.997020 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 570/1209] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:33 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:35.013963 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:35.014583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:35.021147 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:35.021664 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:35.022767 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:35.023234 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:35.086816 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:35.094075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-e9eba969-9769-431f-a1be-6e222bdbc27b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1187 microversion: 2.1 time: 0.084244 Sep 22 13:20:35.096307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 640/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:35 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:36.110568 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:36.111152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:36.117581 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:36.118068 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:36.118846 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:36.119280 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:36.251413 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:36.260421 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-28931c54-101b-4f4c-91c8-c3325753fa57 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1273 microversion: 2.1 time: 0.153543 Sep 22 13:20:36.261144 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 571/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:36 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:20:37.278966 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-ea530b8c-5d99-4449-9e89-6e14b84b33d4 req-57dcfefa-d10a-46bf-b1d8-34ce0eb23df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:37.281551 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:20:37.281551 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:20:37.282152 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:37.284229 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:37.290225 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ea530b8c-5d99-4449-9e89-6e14b84b33d4 req-57dcfefa-d10a-46bf-b1d8-34ce0eb23df1 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:37.294818 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-ea530b8c-5d99-4449-9e89-6e14b84b33d4 req-57dcfefa-d10a-46bf-b1d8-34ce0eb23df1 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:37.295226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:37.295226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:37.295226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:37.295226 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:37.307941 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-ea530b8c-5d99-4449-9e89-6e14b84b33d4 req-57dcfefa-d10a-46bf-b1d8-34ce0eb23df1 service nova] Creating event network-changed:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:20:37.315140 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-ea530b8c-5d99-4449-9e89-6e14b84b33d4 req-57dcfefa-d10a-46bf-b1d8-34ce0eb23df1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041295 Sep 22 13:20:37.315766 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 641/1212] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:20:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:20:37.437757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:37.445793 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-9f35b817-e4d1-400d-818c-b420cb3b4933 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.171460 Sep 22 13:20:37.455218 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 572/1213] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:37 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:20:38.462878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:38.467073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:38.469862 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:38.470326 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:38.471075 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:38.471525 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:38.601059 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:38.609701 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4f890837-abba-45df-98f2-2ad9019c4c4f tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.150841 Sep 22 13:20:38.610269 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 642/1214] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:38 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:39.627201 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:39.627838 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:39.634989 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:39.638545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:39.638545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:39.638545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:39.756425 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:39.764667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-87e3fd61-1166-4708-837d-006c1805ce07 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.141265 Sep 22 13:20:39.765230 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 573/1215] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:39 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:40.780691 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:40.781301 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:40.787120 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:40.787606 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:40.788369 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:40.788803 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:40.908418 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:40.916305 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d8887064-09f3-4d12-a1ae-38f173f9475b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.139236 Sep 22 13:20:40.916875 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 643/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:40 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:41.932970 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:41.933560 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:41.939662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:41.940114 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:41.940892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:41.941324 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:42.062674 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:42.069918 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-cafb9b85-23bd-42da-95c2-04fa8dc174c7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.140895 Sep 22 13:20:42.071155 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 574/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:41 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:43.086730 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:43.087484 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:43.093198 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:43.093637 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:43.094396 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:43.094821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:43.219627 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:43.226982 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4db82bc0-1748-49eb-835f-21ad14c0d1a6 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.144098 Sep 22 13:20:43.228329 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 644/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:43 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:44.244187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:44.244791 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:44.250788 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:44.251234 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:44.252082 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:44.252514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:44.373571 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:44.381081 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-af2fd106-0023-4517-a603-f533cadd0bd0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.140590 Sep 22 13:20:44.381638 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 575/1219] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:44 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:45.397727 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:45.398341 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:45.405171 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:45.405609 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:45.406378 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:45.406809 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:45.531785 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:45.538932 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c2a48a12-9b7d-4cd5-ad29-a28c90091080 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.144846 Sep 22 13:20:45.540176 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 645/1220] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:45 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:46.557548 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:46.558154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:46.564179 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:46.564627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:46.565401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:46.565834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:46.689205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:46.697116 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1df1eb0a-42ce-4126-bb6d-4577d3569bd2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.143891 Sep 22 13:20:46.697834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 576/1221] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:46 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:47.714597 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:47.715380 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:47.721531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:47.721975 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:47.722758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:47.723187 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:47.846554 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:47.854813 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d26d1d9d-6259-40ba-a5c3-d4161fa7d53a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.144530 Sep 22 13:20:47.855375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 646/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:47 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:48.871512 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:48.872116 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:48.878007 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:48.878694 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:48.879490 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:48.879920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:49.006203 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:49.014702 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ef2cd43c-f7b1-498f-9fd3-1bd51bcdee24 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.147559 Sep 22 13:20:49.015279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 577/1223] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:48 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:49.322940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-783b88d5-ae4c-4800-993b-923afdff3367 req-c064ada7-d926-4bbb-a643-2952b61f6779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "name": "network-vif-plugged", "status": "completed", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:49.324797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:20:49.324797 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:20:49.331733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-783b88d5-ae4c-4800-993b-923afdff3367 req-c064ada7-d926-4bbb-a643-2952b61f6779 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:49.332177 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-783b88d5-ae4c-4800-993b-923afdff3367 req-c064ada7-d926-4bbb-a643-2952b61f6779 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:49.344215 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-783b88d5-ae4c-4800-993b-923afdff3367 req-c064ada7-d926-4bbb-a643-2952b61f6779 service nova] Creating event network-vif-plugged:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:20:49.349246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-783b88d5-ae4c-4800-993b-923afdff3367 req-c064ada7-d926-4bbb-a643-2952b61f6779 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Sep 22 13:20:49.349762 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 647/1224] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:20:50.031775 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:50.032445 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:50.038616 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:50.039347 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:50.040209 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:50.040667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:50.168820 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:50.176126 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3adf5b97-19dd-4d07-aeac-585612109bbc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1261 microversion: 2.1 time: 0.148340 Sep 22 13:20:50.176682 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 578/1225] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:50 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:51.194027 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:51.194721 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:51.201413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:51.201855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:51.202616 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:51.203049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:51.328258 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:51.335407 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-044a47cf-c0b4-4b14-a0d8-31bb392c2f6a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1445 microversion: 2.1 time: 0.145421 Sep 22 13:20:51.336004 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 648/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:51 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1445 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:51.351334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:20:51.351976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:20:51.358514 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:51.358964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:51.359751 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:51.360185 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:51.479134 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:20:51.486352 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b5af8eb2-6e34-4839-814e-f17557d104cc tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1445 microversion: 2.1 time: 0.138720 Sep 22 13:20:51.486914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 579/1227] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:20:51 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1445 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:20:53.787363 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-b964415b-f4e0-402a-8087-99da6259f87a req-b04881ce-435c-410b-875c-26f511b8cac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:20:53.788867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:20:53.788867 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:20:53.796247 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b964415b-f4e0-402a-8087-99da6259f87a req-b04881ce-435c-410b-875c-26f511b8cac3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:20:53.796689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-b964415b-f4e0-402a-8087-99da6259f87a req-b04881ce-435c-410b-875c-26f511b8cac3 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:20:53.808282 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-b964415b-f4e0-402a-8087-99da6259f87a req-b04881ce-435c-410b-875c-26f511b8cac3 service nova] Creating event network-changed:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:20:53.813330 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-b964415b-f4e0-402a-8087-99da6259f87a req-b04881ce-435c-410b-875c-26f511b8cac3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029576 Sep 22 13:20:53.813937 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 649/1228] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:20:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:21:48.121284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-945102278", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-289619331", "security_groups": [{"name": "tempest-secgroup-smoke-1876939705"}], "block_device_mapping_v2": [{"uuid": "7501dab5-f38d-4a5a-8be8-e94e75865e4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b2b60ff-ffa7-4f74-a063-d8f4477f3f78"}]}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:21:48.129905 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4de4d457-e521-4523-925d-5fa208feca2f] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 13:21:48.327281 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.network.neutron [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] validate_networks() for [('3b2b60ff-ffa7-4f74-a063-d8f4477f3f78', None, None, None, None, None)] {{(pid=109167) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 22 13:21:48.756779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 13:21:48.757241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image limits 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 13:21:48.757712 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Flavor pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 13:21:48.758118 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Image pref 0:0:0 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 13:21:48.758545 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.virt.hardware [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 13:21:48.767532 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:48.767979 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:48.768764 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:48.769182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:48.786253 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 22 13:21:48.789939 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.quota [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Getting quotas for user bc4e105d110b4129b0765f02a4dbde7f and project 506fa8c4d7e84973979a953f64caa8e3. Resources: {'cores', 'instances', 'ram'} {{(pid=109167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 22 13:21:48.850149 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Going to run 1 instances... {{(pid=109167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 22 13:21:48.852266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7501dab5-f38d-4a5a-8be8-e94e75865e4c',volume_size=None,volume_type=None)] {{(pid=109167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 22 13:21:49.169096 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] [4de4d457-e521-4523-925d-5fa208feca2f] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41456. Sep 22 13:21:49.265258 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-27d2a349-fade-40d2-9f8f-4313840b6657 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.148164 Sep 22 13:21:49.265898 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 580/1229] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Sep 22 13:21:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 13:21:49.276361 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-eab024e6-a382-4024-960d-fa2dd34c0704 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:49.277652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-eab024e6-a382-4024-960d-fa2dd34c0704 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:49.280129 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca28f11a-69c9-4472-8016-495d73f9a384] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 13:21:49.380802 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-eab024e6-a382-4024-960d-fa2dd34c0704 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:49.388531 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-eab024e6-a382-4024-960d-fa2dd34c0704 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1093 microversion: 2.1 time: 0.116338 Sep 22 13:21:49.389089 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 650/1230] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:49 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:50.405858 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:50.406487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:50.412487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:50.412935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:50.413736 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:50.414182 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:50.474531 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:50.482778 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c76be3e4-20e2-4bc3-972e-74e6b5cb8727 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1143 microversion: 2.1 time: 0.081378 Sep 22 13:21:50.483348 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 581/1231] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:50 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:51.499965 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:51.500685 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:51.518874 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:51.519319 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:51.520118 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:51.520549 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:51.538821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca28f11a-69c9-4472-8016-495d73f9a384] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41478. Sep 22 13:21:51.612213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:51.620344 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-1438fb6d-8838-4ad1-9e59-bca1a1e45c66 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1199 microversion: 2.1 time: 0.124708 Sep 22 13:21:51.622025 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 651/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:51 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:52.638911 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:52.639597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:52.645448 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:52.645907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:52.646679 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:52.647115 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:52.773279 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:52.781450 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7742bb72-4979-49ed-9929-35d1fa9bdc84 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1277 microversion: 2.1 time: 0.147263 Sep 22 13:21:52.782325 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 582/1233] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:52 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:53.212699 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-c6097c08-ebb7-4fe4-88ee-f73cde2453ab req-a8dc715e-5371-4555-bb5d-3b9399432c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ac84d6-fab2-4e82-8176-11ecc05ba646", "tag": "091a8767-2d8d-4875-a887-c656af74a9f4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:21:53.214214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:21:53.214214 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:21:53.221513 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-c6097c08-ebb7-4fe4-88ee-f73cde2453ab req-a8dc715e-5371-4555-bb5d-3b9399432c48 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:53.221952 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-c6097c08-ebb7-4fe4-88ee-f73cde2453ab req-a8dc715e-5371-4555-bb5d-3b9399432c48 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:53.233728 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-c6097c08-ebb7-4fe4-88ee-f73cde2453ab req-a8dc715e-5371-4555-bb5d-3b9399432c48 service nova] Creating event network-changed:091a8767-2d8d-4875-a887-c656af74a9f4 for instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 on hv-cinder-81000 Sep 22 13:21:53.238805 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-c6097c08-ebb7-4fe4-88ee-f73cde2453ab req-a8dc715e-5371-4555-bb5d-3b9399432c48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095392 Sep 22 13:21:53.239676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 652/1234] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:21:53.805865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:53.806458 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:53.812855 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:53.813292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:53.814055 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:53.814481 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:53.940945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:53.948232 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-40e2a539-eba5-4d80-af03-77504ef8f251 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.146051 Sep 22 13:21:53.948800 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 583/1235] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:53 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:54.966119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:54.966720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:54.972981 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:54.973428 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:54.974273 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:54.974708 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:55.095277 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:55.102643 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6285313c-ee31-4985-9cc5-b58f1083d386 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.140833 Sep 22 13:21:55.103210 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 653/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:54 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:56.119630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:56.120241 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:56.126454 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:56.126899 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:56.127690 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:56.128125 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:56.246526 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:56.253630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-af73b917-3993-44a3-bf7f-d32096908bfe tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.137899 Sep 22 13:21:56.254661 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 584/1237] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:56 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:57.271830 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:57.272818 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:57.278994 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:57.279454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:57.280223 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:57.280658 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:57.407227 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:57.415280 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-cb5dc569-b9de-4e09-90a4-eca0adb5d3fd tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.147580 Sep 22 13:21:57.415890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 654/1238] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:57 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:58.431763 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:58.473785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:58.473785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:58.473785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:58.473785 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:58.474228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:58.568533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:58.576179 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-b29679f5-14be-4dfc-ac92-e52a85f512a5 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.148058 Sep 22 13:21:58.576768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 585/1239] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:58 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:21:59.594049 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:21:59.596068 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:21:59.601572 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:59.602018 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:59.602804 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:21:59.603252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:21:59.733812 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:21:59.742030 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-d72a4aa9-4561-4d94-867a-6274ebfb3968 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.151614 Sep 22 13:21:59.742681 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 655/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:21:59 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:00.758831 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:00.765988 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:00.765988 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:00.766212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:00.767056 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:00.767511 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:00.892211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:00.899710 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-c099a793-c1d3-45af-bcf6-af0a9ac2c79f tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.144567 Sep 22 13:22:00.900292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 586/1241] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:00 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:01.916325 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:01.916890 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:01.922660 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:01.923138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:01.923943 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:01.924462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:02.050157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:02.057973 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-7d8683e2-7694-4eaa-b7d7-d00cbbbdc6d3 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.145356 Sep 22 13:22:02.058567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 656/1242] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:01 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:03.074655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:03.075447 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:03.082228 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:03.082673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:03.083452 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:03.083914 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:03.207336 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:03.214998 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-eb41f143-4a0a-44a0-911c-211230c69535 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.144175 Sep 22 13:22:03.215870 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 587/1243] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:03 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:03.635674 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-d381b850-724d-4919-ad64-e80ccae863c4 req-a6ceabca-0f30-44a5-ba44-f237b75adb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ac84d6-fab2-4e82-8176-11ecc05ba646", "name": "network-vif-plugged", "status": "completed", "tag": "091a8767-2d8d-4875-a887-c656af74a9f4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:22:03.637504 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:22:03.637504 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:22:03.644197 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d381b850-724d-4919-ad64-e80ccae863c4 req-a6ceabca-0f30-44a5-ba44-f237b75adb76 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:03.644630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-d381b850-724d-4919-ad64-e80ccae863c4 req-a6ceabca-0f30-44a5-ba44-f237b75adb76 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:03.655559 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-d381b850-724d-4919-ad64-e80ccae863c4 req-a6ceabca-0f30-44a5-ba44-f237b75adb76 service nova] Creating event network-vif-plugged:091a8767-2d8d-4875-a887-c656af74a9f4 for instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 on hv-cinder-81000 Sep 22 13:22:03.660873 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-d381b850-724d-4919-ad64-e80ccae863c4 req-a6ceabca-0f30-44a5-ba44-f237b75adb76 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083531 Sep 22 13:22:03.661642 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 657/1244] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:22:04.231866 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:04.232471 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:04.238540 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:04.238985 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:04.239810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:04.240332 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:04.362132 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:04.369468 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d9e06f0f-f772-44f6-9e09-8179c09e4d14 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1265 microversion: 2.1 time: 0.141281 Sep 22 13:22:04.370042 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 588/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:04 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:05.387219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:05.387855 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:05.394489 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:05.394934 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:05.395754 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:05.396190 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:05.522200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:05.529532 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f79b2c44-24f3-4e32-bedf-a2a88e0002a0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1449 microversion: 2.1 time: 0.146731 Sep 22 13:22:05.530091 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 658/1246] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:05 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:05.546166 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:05.546768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:05.553253 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:05.553698 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:05.554470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:05.554902 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:05.838388 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:05.846608 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-dc95c61b-1c24-48d1-9079-c26d8ed75593 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1449 microversion: 2.1 time: 0.303481 Sep 22 13:22:05.847193 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 589/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:05 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1449 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:08.028494 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-4e8e0c74-6abc-4628-8c2a-413e179fcf0a req-cb198b81-7861-4f99-9295-b21254bc77d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ac84d6-fab2-4e82-8176-11ecc05ba646", "tag": "091a8767-2d8d-4875-a887-c656af74a9f4"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:22:08.030536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:22:08.030536 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:22:08.037603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4e8e0c74-6abc-4628-8c2a-413e179fcf0a req-cb198b81-7861-4f99-9295-b21254bc77d6 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:08.038057 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-4e8e0c74-6abc-4628-8c2a-413e179fcf0a req-cb198b81-7861-4f99-9295-b21254bc77d6 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:08.050352 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-4e8e0c74-6abc-4628-8c2a-413e179fcf0a req-cb198b81-7861-4f99-9295-b21254bc77d6 service nova] Creating event network-changed:091a8767-2d8d-4875-a887-c656af74a9f4 for instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 on hv-cinder-81000 Sep 22 13:22:08.056302 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-4e8e0c74-6abc-4628-8c2a-413e179fcf0a req-cb198b81-7861-4f99-9295-b21254bc77d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093275 Sep 22 13:22:08.056915 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 659/1248] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:22:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:22:40.049425 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:22:40.050121 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:22:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:22:48.996062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:22:48.996641 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:49.002335 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:49.002771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:49.003655 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:49.004079 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:49.027892 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lazy-loading 'flavor' on Instance uuid 2e232981-cb78-471c-aef3-625d5d75a1af {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:22:49.309266 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [6d80ae3b-e8eb-4bd4-bf43-bfc1cd13e90a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 13:22:50.325207 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [6d80ae3b-e8eb-4bd4-bf43-bfc1cd13e90a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41546. Sep 22 13:22:50.328507 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-fb33f1a1-29d1-4e72-bef4-18258ca3bf00 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "POST /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af/action" status: 202 len: 0 microversion: 2.1 time: 1.336595 Sep 22 13:22:50.329093 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 590/1249] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:22:48 2021] POST /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af/action => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:22:50.338426 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:50.340198 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:50.346235 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:50.346616 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:50.347383 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:50.347835 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:50.471070 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:50.478436 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ad14b33e-de02-4a1a-87b5-8c57f2bd6e51 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.144814 Sep 22 13:22:50.479076 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 660/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:50 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:51.496389 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:51.497080 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:51.503138 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:51.503618 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:51.504386 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:51.504821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:51.625642 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:51.632920 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-01661d52-4ad1-4409-90f4-a011642782d2 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.140682 Sep 22 13:22:51.633509 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 591/1251] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:51 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:52.650289 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:52.650918 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:52.657496 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:52.657928 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:52.658676 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:52.659097 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:52.780043 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:52.787327 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-15d1a7ce-c0b5-4b30-bf4e-e60894e2c31e tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.140878 Sep 22 13:22:52.787921 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 661/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:52 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:53.805335 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:53.805964 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:53.811847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:53.812311 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:53.813078 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:53.813510 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:53.934472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:53.941802 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-d87f2e00-dcaf-40cc-ab71-699412112a0a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.140216 Sep 22 13:22:53.942292 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 592/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:53 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:54.958907 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:54.959571 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:54.966237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:54.966640 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:54.967413 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:54.967882 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:55.095386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:55.102741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-0b77d273-08a3-40a6-af7b-07d0eb0c9b86 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.147613 Sep 22 13:22:55.103300 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 662/1254] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:54 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:56.119890 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:56.120662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:56.126404 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:56.126841 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:56.127677 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:56.128074 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:56.250587 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:56.258037 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-70930509-f4de-4361-8741-abd10814fee4 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.141936 Sep 22 13:22:56.258595 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 593/1255] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:56 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:57.275307 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:57.275940 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:57.282560 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:57.282996 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:57.283779 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:57.284208 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:57.406508 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:57.413831 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-f557b441-7bcc-4645-b538-1f6cf4a10858 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.142238 Sep 22 13:22:57.414620 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 663/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:57 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:58.430480 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:58.431062 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:58.437550 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:58.437999 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:58.438757 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:58.439187 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:58.557436 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:58.565397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-1c1a8ec1-e18c-4fb7-8197-62d089f532b0 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.138667 Sep 22 13:22:58.565976 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 594/1257] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:58 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:22:59.582781 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:22:59.583386 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:22:59.590114 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:59.590563 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:59.591342 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:22:59.591814 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:22:59.711891 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:22:59.719583 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ea982051-028d-41cb-b131-32fd78f905ee tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.140412 Sep 22 13:22:59.720151 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 664/1258] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:22:59 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:00.736872 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:00.737465 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:00.743263 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:00.743771 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:00.744553 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:00.744987 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:00.867375 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:00.875535 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-e9bfac0f-38aa-492b-977d-5a5c2dc8ceaa tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.142326 Sep 22 13:23:00.876105 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 595/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:00 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:01.892808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:01.893713 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:01.899538 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:01.899989 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:01.900784 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:01.901219 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:02.027310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:02.034594 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-5cc16f80-0284-47fe-aea8-3a8ed8baf956 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.145429 Sep 22 13:23:02.035157 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 665/1260] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:01 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:03.051921 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:03.052487 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:03.058113 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:03.058552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:03.059313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:03.059768 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:03.189865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:03.197580 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-5a4f1701-b752-43bf-8d91-cb7b51d8ce2d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.149383 Sep 22 13:23:03.198170 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 596/1261] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:03 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:04.214046 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:04.215255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:04.221189 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.221630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.222394 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.222818 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.342053 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:04.349375 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6655f537-33bd-49dd-bfe7-9afa7c6f5a3b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1511 microversion: 2.1 time: 0.139045 Sep 22 13:23:04.349931 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 666/1262] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:04 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:04.365794 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:04.366333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:04.372219 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.372657 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.373417 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.373843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.691621 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2dcead07-29b6-4801-b29f-801e81ceb4be tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "POST /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af/action" status: 202 len: 0 microversion: 2.1 time: 0.329426 Sep 22 13:23:04.692222 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 597/1263] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Sep 22 13:23:04 2021] POST /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:23:04.700640 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:04.701255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:04.707039 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.707528 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.708303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:04.708733 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:04.861137 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:04.868506 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-3104229b-f46f-4840-b7aa-552bcf4afa3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1519 microversion: 2.1 time: 0.172049 Sep 22 13:23:04.869082 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 667/1264] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:04 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:05.887590 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:05.888123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:05.894191 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:05.896154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:05.896154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:05.896154 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:06.017351 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:06.025373 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-3b6b3e72-77d5-4fd8-9586-460302c9d2d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1521 microversion: 2.1 time: 0.142519 Sep 22 13:23:06.025970 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 598/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:05 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:07.042715 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:07.043453 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:07.049395 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:07.049839 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:07.050607 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:07.051038 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:07.217930 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:07.225545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-97a57174-7094-4242-bbb1-3b0b2a4f7d3d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.186424 Sep 22 13:23:07.233056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 668/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:07 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:07.771543 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-3ce609c5-cee0-4784-be12-c1e67e163a11 req-4b075c9f-a1cb-4f98-8a11-e39177a7c4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "name": "network-vif-unplugged", "status": "completed", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:07.776148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:07.776148 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:23:07.780407 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-3ce609c5-cee0-4784-be12-c1e67e163a11 req-4b075c9f-a1cb-4f98-8a11-e39177a7c4f1 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:07.780848 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-3ce609c5-cee0-4784-be12-c1e67e163a11 req-4b075c9f-a1cb-4f98-8a11-e39177a7c4f1 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:07.791783 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-3ce609c5-cee0-4784-be12-c1e67e163a11 req-4b075c9f-a1cb-4f98-8a11-e39177a7c4f1 service nova] Creating event network-vif-unplugged:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:23:07.797630 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-3ce609c5-cee0-4784-be12-c1e67e163a11 req-4b075c9f-a1cb-4f98-8a11-e39177a7c4f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029984 Sep 22 13:23:07.798197 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 599/1267] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:23:08.241847 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:08.242441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:08.248448 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:08.248895 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:08.249652 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:08.250087 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:08.369186 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:08.376622 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-c0142f7c-2b21-4be7-8929-9d63024ada9d tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.138423 Sep 22 13:23:08.377192 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 669/1268] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:08 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:09.394414 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:09.395108 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:09.401189 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:09.401635 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:09.402398 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:09.402833 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:09.522945 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:09.531000 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-7ca1e105-1394-4740-9cda-b1dbbc6c31ca tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.141023 Sep 22 13:23:09.531569 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 600/1269] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:09 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:10.548517 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:10.549108 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:10.554944 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:10.555389 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:10.556252 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:10.556689 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:10.675834 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:10.683148 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-b246c5a0-9bad-4905-8216-1279d83ef399 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.138898 Sep 22 13:23:10.683741 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 670/1270] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:10 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:11.700754 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:11.701359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:11.707951 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:11.708397 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:11.709278 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:11.709629 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:11.832673 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:11.840077 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-bf139984-ef6f-4fee-b2af-7696fee5eb67 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.143043 Sep 22 13:23:11.840635 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 601/1271] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:11 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:12.856397 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:12.857008 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:12.862951 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:12.863399 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:12.864259 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:12.864693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:12.988693 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:12.996203 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-07c78859-dede-40a2-91c9-0eb3a5288d1b tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.143597 Sep 22 13:23:12.996768 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 671/1272] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:12 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:14.013346 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:14.013955 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:14.020142 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:14.020584 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:14.021349 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:14.021779 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:14.142687 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:14.150191 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-164c5a36-7fba-41fa-9c79-5d1bb4e1179a tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1577 microversion: 2.1 time: 0.140569 Sep 22 13:23:14.150747 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 602/1273] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:14 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:15.167902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:15.168534 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:15.175073 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:15.175561 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:15.176328 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:15.176763 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:15.299200 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:15.306454 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-8439c349-66ab-4130-bf90-d1f4fbff4525 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1564 microversion: 2.1 time: 0.142448 Sep 22 13:23:15.307024 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 672/1274] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:15 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:17.844313 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-957fa052-69b4-4b98-bd92-28e61bfa6608 req-1797ebd5-abf5-4e22-b501-4c4b063b837d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "name": "network-vif-plugged", "status": "completed", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:17.845889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:17.845889 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:23:17.852933 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-957fa052-69b4-4b98-bd92-28e61bfa6608 req-1797ebd5-abf5-4e22-b501-4c4b063b837d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:17.853382 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-957fa052-69b4-4b98-bd92-28e61bfa6608 req-1797ebd5-abf5-4e22-b501-4c4b063b837d service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:17.864899 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-957fa052-69b4-4b98-bd92-28e61bfa6608 req-1797ebd5-abf5-4e22-b501-4c4b063b837d service nova] Creating event network-vif-plugged:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:23:17.870013 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-957fa052-69b4-4b98-bd92-28e61bfa6608 req-1797ebd5-abf5-4e22-b501-4c4b063b837d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030190 Sep 22 13:23:17.870597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 603/1275] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:23:30.575633 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:30.576159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:30.577672 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-75342e8d-67ef-40f4-9406-8467353a6af9 req-61581903-6714-40af-8220-ba5e21629856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ac84d6-fab2-4e82-8176-11ecc05ba646", "tag": "091a8767-2d8d-4875-a887-c656af74a9f4"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:30.580359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:30.580359 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:23:30.583026 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:30.583574 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:30.584474 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:30.584976 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:30.587992 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-75342e8d-67ef-40f4-9406-8467353a6af9 req-61581903-6714-40af-8220-ba5e21629856 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:30.588422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-75342e8d-67ef-40f4-9406-8467353a6af9 req-61581903-6714-40af-8220-ba5e21629856 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:30.601929 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-75342e8d-67ef-40f4-9406-8467353a6af9 req-61581903-6714-40af-8220-ba5e21629856 service nova] Creating event network-changed:091a8767-2d8d-4875-a887-c656af74a9f4 for instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 on hv-cinder-81000 Sep 22 13:23:30.608161 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-75342e8d-67ef-40f4-9406-8467353a6af9 req-61581903-6714-40af-8220-ba5e21629856 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033901 Sep 22 13:23:30.608775 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 604/1276] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:23:30.612998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:23:30.973271 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-57e5bdd7-138a-440a-bd30-169a9c8d30bb tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 204 len: 0 microversion: 2.1 time: 0.401695 Sep 22 13:23:30.983052 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:30.983772 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:30.985569 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 673/1277] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:23:30 2021] DELETE /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:23:30.994305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:30.994305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:30.994305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:30.994305 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:31.124847 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:31.132202 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-6d21285d-45f4-4edf-87a3-8072cc259635 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1574 microversion: 2.1 time: 0.153173 Sep 22 13:23:31.133024 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 605/1278] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:30 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:23:32.150446 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:32.151138 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:32.157314 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:32.157758 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:32.158529 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:32.158961 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:32.284322 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:32.292246 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a9461e1b-b725-4b1f-9544-cae891682cbc tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1455 microversion: 2.1 time: 0.145987 Sep 22 13:23:32.298614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 674/1279] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:32 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:33.212016 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-b968ecf7-b1dd-4024-9925-c6bc2bb6358f req-bb26a90b-7621-4695-9c77-63abdfda38fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ac84d6-fab2-4e82-8176-11ecc05ba646", "name": "network-vif-deleted", "tag": "091a8767-2d8d-4875-a887-c656af74a9f4"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:33.213533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:33.213533 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:23:33.221505 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-b968ecf7-b1dd-4024-9925-c6bc2bb6358f req-bb26a90b-7621-4695-9c77-63abdfda38fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:33.222040 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-b968ecf7-b1dd-4024-9925-c6bc2bb6358f req-bb26a90b-7621-4695-9c77-63abdfda38fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:33.233738 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-b968ecf7-b1dd-4024-9925-c6bc2bb6358f req-bb26a90b-7621-4695-9c77-63abdfda38fa service nova] Creating event network-vif-deleted:091a8767-2d8d-4875-a887-c656af74a9f4 for instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 on hv-cinder-81000 Sep 22 13:23:33.239552 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-b968ecf7-b1dd-4024-9925-c6bc2bb6358f req-bb26a90b-7621-4695-9c77-63abdfda38fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031025 Sep 22 13:23:33.240056 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 606/1280] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:23:33.309953 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:33.310545 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:33.318201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:33.318748 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:33.319540 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:33.319969 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:33.383443 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:33.391457 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-efee938c-5e30-4d43-a40d-1e03dfae4637 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1224 microversion: 2.1 time: 0.085216 Sep 22 13:23:33.393653 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 675/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:33 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:34.410968 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:34.411810 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:34.417986 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:34.418431 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:34.419205 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:34.419666 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:34.453401 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:34.453828 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:34.454291 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.objects.instance [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lazy-loading 'fault' on Instance uuid c2ac84d6-fab2-4e82-8176-11ecc05ba646 {{(pid=109167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 22 13:23:34.503129 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:34.509907 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-199d21b0-279e-4883-ace2-d78e98408a50 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 200 len: 1183 microversion: 2.1 time: 0.104310 Sep 22 13:23:34.510483 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 607/1282] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:34 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 1183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:35.528567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:35.529155 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: c2ac84d6-fab2-4e82-8176-11ecc05ba646] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:35.536293 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:35.536742 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:35.537512 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:35.537947 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:35.551906 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] HTTP exception thrown: Instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 could not be found. Sep 22 13:23:35.552491 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Returning 404 to user: Instance c2ac84d6-fab2-4e82-8176-11ecc05ba646 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:23:35.553310 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-86e44242-f0f6-4627-8d8c-e23993a03037 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646" status: 404 len: 111 microversion: 2.1 time: 0.028562 Sep 22 13:23:35.553844 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 676/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:35 2021] GET /compute/v2.1/servers/c2ac84d6-fab2-4e82-8176-11ecc05ba646 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:23:39.031494 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-9d8f5739-abf8-4263-a58a-1e994d27b8d5 req-5448e76e-b6d7-4e36-bb6f-fe2e81741973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a6fb66-08b8-4248-adb0-62b4e4c9ce54", "tag": "3cd57090-ec8a-4ed8-9989-2aeebda1778d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:39.032592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:39.032592 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:23:39.037604 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:39.038285 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:39.045124 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9d8f5739-abf8-4263-a58a-1e994d27b8d5 req-5448e76e-b6d7-4e36-bb6f-fe2e81741973 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:39.045555 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-9d8f5739-abf8-4263-a58a-1e994d27b8d5 req-5448e76e-b6d7-4e36-bb6f-fe2e81741973 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:39.046211 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:39.047025 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:39.048314 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:39.048935 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:39.058047 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-9d8f5739-abf8-4263-a58a-1e994d27b8d5 req-5448e76e-b6d7-4e36-bb6f-fe2e81741973 service nova] Creating event network-changed:3cd57090-ec8a-4ed8-9989-2aeebda1778d for instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 on hv-cinder-81000 Sep 22 13:23:39.063800 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-9d8f5739-abf8-4263-a58a-1e994d27b8d5 req-5448e76e-b6d7-4e36-bb6f-fe2e81741973 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036343 Sep 22 13:23:39.064585 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 677/1284] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 13:23:39.082145 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Going to try to terminate instance {{(pid=109167) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:23:39.418834 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-ba916a7f-0d4f-47f8-91dc-d90137ee49ef tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 204 len: 0 microversion: 2.1 time: 0.394311 Sep 22 13:23:39.419422 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 608/1285] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:23:39 2021] DELETE /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:23:39.428119 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:39.430286 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:39.435304 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:39.435775 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:39.436843 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:39.437275 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:39.649348 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:39.657441 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-6be23658-fe09-4371-bcbf-83200832d78d tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1574 microversion: 2.1 time: 0.233269 Sep 22 13:23:39.658016 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 678/1286] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:39 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:40.675284 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:40.676139 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:40.682075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:40.682513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:40.691700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:40.691700 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:40.832423 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:40.842212 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-52124d07-b03c-432b-a701-938851006e07 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1456 microversion: 2.1 time: 0.171551 Sep 22 13:23:40.842811 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 609/1287] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:40 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1456 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:23:41.556045 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [req-dce2749d-76c8-4640-a78c-2590c27088af req-c2e51c09-87bd-44cc-b694-e5796dcbc0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a6fb66-08b8-4248-adb0-62b4e4c9ce54", "name": "network-vif-deleted", "tag": "3cd57090-ec8a-4ed8-9989-2aeebda1778d"}]} {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:23:41.559463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:23:41.559463 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: warnings.warn(msg) Sep 22 13:23:41.571390 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-dce2749d-76c8-4640-a78c-2590c27088af req-c2e51c09-87bd-44cc-b694-e5796dcbc0fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:41.571852 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [req-dce2749d-76c8-4640-a78c-2590c27088af req-c2e51c09-87bd-44cc-b694-e5796dcbc0fa service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:41.584143 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.compute.server_external_events [req-dce2749d-76c8-4640-a78c-2590c27088af req-c2e51c09-87bd-44cc-b694-e5796dcbc0fa service nova] Creating event network-vif-deleted:3cd57090-ec8a-4ed8-9989-2aeebda1778d for instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 on hv-cinder-81000 Sep 22 13:23:41.589270 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [req-dce2749d-76c8-4640-a78c-2590c27088af req-c2e51c09-87bd-44cc-b694-e5796dcbc0fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040343 Sep 22 13:23:41.590077 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 679/1288] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:23:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:23:41.864123 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:41.866944 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:41.874970 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:41.875463 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:41.876299 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:41.876753 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:41.950446 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4e105d110b4129b0765f02a4dbde7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506fa8c4d7e84973979a953f64caa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:23:41.966156 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-64dba774-42b7-4003-b447-b33703f60e69 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 200 len: 1224 microversion: 2.1 time: 0.108666 Sep 22 13:23:41.967472 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 610/1289] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:41 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 13:23:42.991411 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:42.992614 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 09a6fb66-08b8-4248-adb0-62b4e4c9ce54] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:43.003460 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.004196 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.005449 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.006152 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.030591 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] HTTP exception thrown: Instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 could not be found. Sep 22 13:23:43.031682 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Returning 404 to user: Instance 09a6fb66-08b8-4248-adb0-62b4e4c9ce54 could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:23:43.033180 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-2a468735-5064-44e4-ba06-0a2b0a213f4a tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54" status: 404 len: 111 microversion: 2.1 time: 0.047013 Sep 22 13:23:43.034159 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 680/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:42 2021] GET /compute/v2.1/servers/09a6fb66-08b8-4248-adb0-62b4e4c9ce54 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:23:43.632049 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:43.632669 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:43.638946 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.639400 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.640227 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.640667 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.655597 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] HTTP exception thrown: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. Sep 22 13:23:43.656216 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Returning 404 to user: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:23:43.657075 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-04548a2a-ada4-4c13-859a-9a7bd82de0f0 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 404 len: 111 microversion: 2.1 time: 0.029268 Sep 22 13:23:43.657640 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 611/1291] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:23:43 2021] DELETE /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:23:43.666636 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:43.667255 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] [instance: 7125b6ac-217a-4c3b-a263-7459bb3268ae] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:23:43.673821 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.674294 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.675732 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:23:43.676201 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:23:43.691267 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.wsgi [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] HTTP exception thrown: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. Sep 22 13:23:43.691720 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Returning 404 to user: Instance 7125b6ac-217a-4c3b-a263-7459bb3268ae could not be found. {{(pid=109168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:23:43.692576 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-ad7e551d-cda4-4086-aae8-3757da9d97f8 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae" status: 404 len: 111 microversion: 2.1 time: 0.029909 Sep 22 13:23:43.693141 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 681/1292] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:23:43 2021] GET /compute/v2.1/servers/7125b6ac-217a-4c3b-a263-7459bb3268ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 13:23:45.225439 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-260a79ad-e808-4279-9300-c456f5079682 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] Calling method '.version_select at 0x7fa712ff2280>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:23:45.323513 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-260a79ad-e808-4279-9300-c456f5079682 tempest-TestVolumeBootPattern-417824677 tempest-TestVolumeBootPattern-417824677-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-289619331" status: 202 len: 0 microversion: 2.1 time: 0.103065 Sep 22 13:23:45.324092 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 612/1293] 10.222.0.43 () {58 vars in 1260 bytes} [Wed Sep 22 13:23:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-289619331 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 13:24:29.566603 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:24:29.567213 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:24:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:24:29.694171 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-ccf183d9-5210-4c40-8f05-65d861fa26e0 req-2bbc5acd-0e37-4526-8c5f-ae7e8a89af7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:24:29.696627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:24:29.696627 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:24:29.698136 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:29.698630 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:24:29.705237 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:29.705845 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ccf183d9-5210-4c40-8f05-65d861fa26e0 req-2bbc5acd-0e37-4526-8c5f-ae7e8a89af7b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:29.705979 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:29.706430 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-ccf183d9-5210-4c40-8f05-65d861fa26e0 req-2bbc5acd-0e37-4526-8c5f-ae7e8a89af7b service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:29.706627 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:29.707056 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:29.718204 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-ccf183d9-5210-4c40-8f05-65d861fa26e0 req-2bbc5acd-0e37-4526-8c5f-ae7e8a89af7b service nova] Creating event network-changed:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:24:29.723798 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-ccf183d9-5210-4c40-8f05-65d861fa26e0 req-2bbc5acd-0e37-4526-8c5f-ae7e8a89af7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033336 Sep 22 13:24:29.724662 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 613/1294] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:24:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:24:29.734058 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Going to try to terminate instance {{(pid=109168) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 22 13:24:30.039146 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-4e4af547-091e-4099-beb1-c066841929a7 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 204 len: 0 microversion: 2.1 time: 0.351526 Sep 22 13:24:30.042959 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 682/1295] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Sep 22 13:24:29 2021] DELETE /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 13:24:30.048937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:30.049867 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:24:30.057167 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:30.057641 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:30.058451 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:30.058883 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:30.198607 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.policy [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109167) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:24:30.208843 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-a99fd864-b9ee-40b7-8be4-2ee37540e745 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1570 microversion: 2.1 time: 0.162927 Sep 22 13:24:30.217865 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 614/1296] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:24:30 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:24:31.225819 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:31.226515 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:24:31.232364 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:31.232808 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:31.233567 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:31.233998 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:31.360958 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:24:31.368303 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a51e6848-06e9-46dd-9acc-ff4663d0c9d1 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1451 microversion: 2.1 time: 0.146529 Sep 22 13:24:31.368872 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 683/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:24:31 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:24:32.116972 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [req-1c56fd5b-f0ed-41ac-928f-4243dded04ae req-fa1fc4b1-e12c-4294-b73d-3396b00a4892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e232981-cb78-471c-aef3-625d5d75a1af", "name": "network-vif-deleted", "tag": "d6022fd2-a74c-4d0a-9f2c-9364a9276394"}]} {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 13:24:32.118470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 13:24:32.118470 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: warnings.warn(msg) Sep 22 13:24:32.125333 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-1c56fd5b-f0ed-41ac-928f-4243dded04ae req-fa1fc4b1-e12c-4294-b73d-3396b00a4892 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:32.125772 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [req-1c56fd5b-f0ed-41ac-928f-4243dded04ae req-fa1fc4b1-e12c-4294-b73d-3396b00a4892 service nova] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:32.136469 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.compute.server_external_events [req-1c56fd5b-f0ed-41ac-928f-4243dded04ae req-fa1fc4b1-e12c-4294-b73d-3396b00a4892 service nova] Creating event network-vif-deleted:d6022fd2-a74c-4d0a-9f2c-9364a9276394 for instance 2e232981-cb78-471c-aef3-625d5d75a1af on hv-cinder-81000 Sep 22 13:24:32.142223 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [req-1c56fd5b-f0ed-41ac-928f-4243dded04ae req-fa1fc4b1-e12c-4294-b73d-3396b00a4892 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029077 Sep 22 13:24:32.142821 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 615/1298] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Sep 22 13:24:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 13:24:32.386309 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:32.386926 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.compute.api [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109168) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:24:32.393878 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:32.394321 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:32.395109 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:32.395608 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG oslo_concurrency.lockutils [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:32.464055 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.policy [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87327f71209d4ebab3fb465c88b149c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1e0e70b73e4fb1b5208231b5468fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109168) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 13:24:32.473279 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-a14a9945-83ee-4be0-ac3b-5d0e2f4e93fe tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 200 len: 1220 microversion: 2.1 time: 0.090724 Sep 22 13:24:32.473866 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 684/1299] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:24:32 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 13:24:33.490646 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '>' {{(pid=109167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:33.491334 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.compute.api [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] [instance: 2e232981-cb78-471c-aef3-625d5d75a1af] Fetching instance by UUID {{(pid=109167) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 22 13:24:33.497474 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:33.497908 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:33.498720 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 22 13:24:33.499188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG oslo_concurrency.lockutils [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Lock "f6b54549-b926-49af-b381-631339695cfe" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 22 13:24:33.512188 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.wsgi [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] HTTP exception thrown: Instance 2e232981-cb78-471c-aef3-625d5d75a1af could not be found. Sep 22 13:24:33.512809 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: DEBUG nova.api.openstack.wsgi [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Returning 404 to user: Instance 2e232981-cb78-471c-aef3-625d5d75a1af could not be found. {{(pid=109167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 22 13:24:33.513726 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO nova.api.openstack.requestlog [None req-2e4eb010-f508-4025-a4e7-42eac16c3806 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af" status: 404 len: 111 microversion: 2.1 time: 0.027365 Sep 22 13:24:33.514249 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: [pid: 109167|app: 0|req: 616/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Sep 22 13:24:33 2021] GET /compute/v2.1/servers/2e232981-cb78-471c-aef3-625d5d75a1af => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 13:24:33.719011 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: DEBUG nova.api.openstack.wsgi [None req-bcd41514-9973-4e3d-a5b1-2cdf007b4320 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] Calling method '.version_select at 0x7fa7180ecb80>' {{(pid=109168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 13:24:33.789212 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO nova.api.openstack.requestlog [None req-bcd41514-9973-4e3d-a5b1-2cdf007b4320 tempest-TestShelveInstance-1146506025 tempest-TestShelveInstance-1146506025-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1820163476" status: 202 len: 0 microversion: 2.1 time: 0.074736 Sep 22 13:24:33.789796 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: [pid: 109168|app: 0|req: 685/1301] 10.222.0.43 () {58 vars in 1254 bytes} [Wed Sep 22 13:24:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1820163476 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 13:26:00.068178 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:26:00.068902 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:26:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:26:16.395251 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:26:16.395904 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: Wed Sep 22 13:26:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:26:33.822848 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:26:33.823482 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:26:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:27:01.370851 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:27:01.371466 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: Wed Sep 22 13:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:27:49.586903 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:27:49.587589 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:27:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:29:20.086222 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:29:20.086958 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:29:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:29:36.413356 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:29:36.413937 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: Wed Sep 22 13:29:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:29:39.670975 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:29:39.671671 dv-cinder-810000-3-iscsi devstack@n-api.service[109167]: Wed Sep 22 13:29:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 22 13:29:53.840865 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 13:29:53.841462 dv-cinder-810000-3-iscsi devstack@n-api.service[109168]: Wed Sep 22 13:29:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!